Sep 25 10:32:11 devstack cinder-volume[75845]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 10:32:11 devstack cinder-volume[75845]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 10:32:11 devstack cinder-volume[75845]: we strongly recommend against using it for new projects. Sep 25 10:32:11 devstack cinder-volume[75845]: If you are already using Eventlet, we recommend migrating to a different Sep 25 10:32:11 devstack cinder-volume[75845]: framework. For more detail see Sep 25 10:32:11 devstack cinder-volume[75845]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 10:32:11 devstack cinder-volume[75845]: import eventlet # noqa Sep 25 10:32:14 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 10:32:14 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 10:32:14 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 10:32:15 devstack cinder-volume[75845]: INFO dbcounter [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Registered counter for database cinder Sep 25 10:32:15 devstack cinder-volume[75845]: DEBUG oslo_db.sqlalchemy.engines [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:32:15 devstack cinder-volume[75845]: DEBUG dbcounter [-] [75845] Writer thread running {{(pid=75845) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 10:32:15 devstack cinder-volume[75845]: INFO cinder.rpc [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 10:32:16 devstack cinder-volume[75845]: INFO cinder.rpc [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_db.sqlalchemy.engines [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:32:16 devstack cinder-volume[75845]: INFO cinder.volume.manager [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Determined volume DB was empty at startup. Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG cinder.volume.manager [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75845) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 10:32:16 devstack cinder-volume[75845]: INFO cinder.volume.manager [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 10:32:16 devstack cinder-volume[75845]: WARNING stevedore.named [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 10:32:16 devstack cinder-volume[75845]: WARNING castellan.key_manager [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 10:32:16 devstack cinder-volume[75845]: WARNING cinder.keymgr.conf_key_mgr [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG cinder.volume.drivers.lvm [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75845) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_concurrency.processutils [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75845) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_concurrency.processutils [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] CMD "cinder-rtstool verify" returned: 0 in 0.505s {{(pid=75845) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_db.sqlalchemy.engines [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:32:16 devstack cinder-volume[75845]: INFO cinder.rpc [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 10:32:16 devstack cinder-volume[75845]: INFO cinder.rpc [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 10:32:16 devstack cinder-volume[75845]: WARNING stevedore.named [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 10:32:16 devstack cinder-volume[75845]: WARNING castellan.key_manager [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 10:32:16 devstack cinder-volume[75845]: INFO cinder.volume.manager [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_db.sqlalchemy.engines [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:32:16 devstack cinder-volume[75845]: INFO oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Starting 1 workers Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Started child 76046 {{(pid=75845) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Full set of CONF: {{(pid=75845) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] ******************************************************************************** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Configuration options gathered from: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] ================================================================================ {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] allow_availability_zone_fallback = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] allow_compression_on_image_upload = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] allowed_direct_url_schemes = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[76046]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] api_rate_limit = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] auth_strategy = keystone {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] az_cache_duration = 3600 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_availability_zone = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_host = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_stats_polling_interval = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backup_api_class = cinder.backup.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backup_name_template = backup-%s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backup_use_same_host = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backup_use_temp_snapshot = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] chap_password = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] chap_username = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cinder_internal_tenant_project_id = 3e60a60cfca44d0cac2a0b4c0e5c9d50 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cinder_internal_tenant_user_id = 6c682b26dc244663a9ea4dfec5b744b4 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cloned_volume_same_az = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cluster = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] compression_format = gzip {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] compute_api_class = cinder.compute.nova.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] config_dir = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] config_source = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] control_exchange = openstack {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] debug = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] default_availability_zone = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] default_group_type = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] default_volume_type = lvmdriver-1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] disk_geometry = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] driver_client_cert = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] driver_client_cert_key = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] driver_data_namespace = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] driver_ssl_cert_path = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] driver_ssl_cert_verify = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] driver_use_ssl = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] enable_force_upload = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] enable_new_services = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] enable_unsupported_driver = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] enabled_backends = ['lvmdriver-1'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] enforce_multipath_for_image_xfer = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] filter_function = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance_api_insecure = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance_api_ssl_compression = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance_ca_certificates_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance_catalog_info = image:glance:publicURL {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance_certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance_keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance_num_retries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance_request_timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] goodness_function = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] graceful_shutdown_timeout = 5 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] group_api_class = cinder.group.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] host = devstack {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] image_compress_on_upload = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] image_conversion_address_space_limit = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] image_conversion_cpu_limit = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] image_conversion_disable = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] image_introspection_address_space_limit = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] image_introspection_cpu_limit = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] image_upload_use_cinder_backend = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] image_upload_use_internal_tenant = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] image_volume_cache_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] image_volume_cache_max_count = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] image_volume_cache_max_size_gb = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] init_host_max_objects_retrieval = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] instance_format = [instance: %(uuid)s] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] iscsi_target_flags = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] iscsi_write_cache = on {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] iser_helper = tgtadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] iser_ip_address = 192.168.122.136 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] iser_port = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] log_color = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] log_config_append = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] log_dir = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] log_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] log_options = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] log_rotate_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] log_rotate_interval_type = days {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] log_rotation_type = none {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[76046]: INFO cinder.volume.manager [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] max_age = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] max_logfile_count = 30 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] max_logfile_size_mb = 200 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] max_over_subscription_ratio = 20.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] message_reap_interval = 86400 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] message_ttl = 2592000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] migration_create_volume_timeout_secs = 300 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] monkey_patch = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] monkey_patch_modules = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] my_ip = 192.168.122.136 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] no_snapshot_gb_quota = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] num_iser_scan_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] num_shell_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] num_volume_device_scan_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] nvmeof_conn_info_version = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] nvmet_ns_id = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] nvmet_port_id = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] osapi_max_limit = 1000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] osapi_volume_ext_list = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] osapi_volume_listen = 0.0.0.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] osapi_volume_listen_port = 8776 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] osapi_volume_use_ssl = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] osapi_volume_workers = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] per_volume_size_limit = -1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] periodic_fuzzy_delay = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] periodic_interval = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] project_id_regex = [0-9a-f\-]+ {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] public_endpoint = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] publish_errors = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] quota_backup_gigabytes = 1000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] quota_backups = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] quota_gigabytes = 1000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] quota_groups = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] quota_snapshots = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] quota_volumes = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] rate_limit_burst = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] rate_limit_except_level = CRITICAL {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] rate_limit_interval = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] reinit_driver_count = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] replication_device = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] report_discard_supported = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] report_interval = 120 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] reservation_clean_interval = 86400 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] reservation_expire = 86400 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] reserved_image_namespaces = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] reserved_percentage = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] rpc_response_timeout = 120 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] run_external_periodic_tasks = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] scst_target_driver = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] scst_target_iqn_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] service_down_time = 720 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] shell_completion = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] snapshot_name_template = snapshot-%s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] snapshot_same_host = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] split_loggers = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] state_path = /opt/stack/data/cinder {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] storage_availability_zone = nova {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] storage_protocol = iSCSI {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] syslog_log_facility = LOG_USER {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] target_helper = lioadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] target_ip_address = 192.168.122.136 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] target_port = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] target_protocol = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] target_secondary_ip_addresses = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] trace_flags = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] transfer_api_class = cinder.transfer.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] transport_url = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] until_refresh = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] use_chap_auth = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] use_default_quota_class = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] use_journal = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] use_json = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] use_multipath_for_image_xfer = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] use_stderr = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] use_syslog = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] verify_glance_signatures = enabled {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] volume_api_class = cinder.volume.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] volume_backend_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] volume_clear = zero {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] volume_clear_ionice = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] volume_clear_size = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] volume_copy_bps_limit = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] volume_dd_blocksize = 1M {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] volume_name_template = volume-%s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] volume_service_inithost_offload = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] volume_usage_audit_period = month {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] zoning_mode = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_concurrency.disable_process_locking = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.auth_section = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.auth_type = password {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.auth_version = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.cache = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.delay_auth_decision = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.http_connect_timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.include_service_catalog = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.insecure = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.interface = public {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_password = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:17 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcache_username = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.region_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.service_token_roles_required = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.service_type = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.token_cache_time = 300 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.backend = dogpile.cache.null {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.backend_argument = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.backend_expiration_time = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.config_prefix = cache.oslo {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.debug_cache_backend = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.enable_retry_client = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.enable_socket_keepalive = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.expiration_time = 600 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.hashclient_retry_attempts = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.memcache_dead_retry = 300 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.memcache_pool_maxsize = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.memcache_sasl_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.password = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.proxies = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.redis_db = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.redis_sentinel_service_name = mymaster {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.redis_server = localhost:6379 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.retry_attempts = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.retry_delay = 0.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.socket_keepalive_count = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.socket_keepalive_idle = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.socket_keepalive_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.socket_timeout = 1.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.tls_allowed_ciphers = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.tls_cafile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.tls_certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.tls_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.tls_keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cache.username = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] coordination.backend_url = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.asyncio_connection = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.asyncio_slave_connection = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.backend = sqlalchemy {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.connection = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.connection_debug = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.connection_parameters = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.connection_recycle_time = 3600 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.connection_trace = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.db_inc_retry_interval = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.db_max_retries = 20 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.db_max_retry_interval = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.db_retry_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.max_overflow = 50 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.max_pool_size = 5 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.max_retries = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.mysql_wsrep_sync_wait = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.pool_timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.retry_interval = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.slave_connection = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.sqlite_synchronous = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.synchronous_reader = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] database.use_db_reconnect = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_tracing.insecure = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] profiler.connection_string = messaging:// {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] profiler.enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] profiler.es_doc_type = notification {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] profiler.es_scroll_size = 10000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] profiler.es_scroll_time = 2m {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] profiler.filter_error_trace = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] profiler.hmac_keys = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack sudo[76104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 10:32:17 devstack sudo[76104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] profiler.sentinel_service_name = mymaster {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] profiler.socket_timeout = 0.1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] profiler.trace_requests = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] profiler.trace_sqlalchemy = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] profiler_jaeger.process_tags = {} {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] profiler_jaeger.service_name_prefix = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] profiler_otlp.service_name_prefix = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_policy.enforce_new_defaults = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_policy.policy_default_rule = default {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_policy.policy_file = policy.yaml {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_policy.remote_timeout = 60.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] privsep_osbrick.group = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] privsep_osbrick.helper_command = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] privsep_osbrick.user = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cinder_sys_admin.group = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cinder_sys_admin.helper_command = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] cinder_sys_admin.user = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] service_user.auth_section = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] service_user.auth_type = password {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] service_user.cafile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] service_user.certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] service_user.collect_timing = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] service_user.insecure = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] service_user.keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] service_user.send_service_user_token = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] service_user.split_loggers = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] service_user.timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] service_user.tls_ciphers = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] service_user.tls_min_version = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance.auth_section = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance.auth_type = password {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance.certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance.collect_timing = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance.insecure = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance.keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance.region_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance.split_loggers = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance.timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance.tls_ciphers = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] glance.tls_min_version = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.backend_availability_zone = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.chap_password = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.chap_username = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.disk_geometry = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.driver_client_cert = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.driver_client_cert_key = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.driver_data_namespace = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.driver_use_ssl = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.enable_unsupported_driver = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.extra_capabilities = {} {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.filter_function = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.goodness_function = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.iscsi_target_flags = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.iscsi_write_cache = on {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.iser_helper = tgtadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.iser_port = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.lvm_mirrors = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.lvm_share_target = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.lvm_type = auto {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.num_shell_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.nvmet_port_id = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.replication_device = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.report_discard_supported = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.reserved_percentage = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.scst_target_driver = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.scst_target_iqn_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.storage_protocol = iSCSI {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.target_helper = tgtadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.target_port = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.target_protocol = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.trace_flags = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.unique_fqdn_network = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.use_chap_auth = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.volume_backend_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.volume_clear = zero {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.volume_clear_ionice = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.volume_clear_size = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.volume_group = cinder-volumes {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_reports.file_event_handler = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_reports.log_dir = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.backend_availability_zone = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.backend_host = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.chap_password = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.chap_username = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.chiscsi_conf = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.disk_geometry = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.driver_client_cert = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.driver_data_namespace = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.driver_use_ssl = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.extra_capabilities = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.filter_function = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.goodness_function = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.iser_helper = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.iser_ip_address = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.iser_port = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.iser_target_prefix = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.lvm_conf_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.lvm_mirrors = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.lvm_share_target = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.lvm_type = auto {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.num_shell_tries = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.nvmet_port_id = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.replication_device = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.report_discard_supported = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.reserved_percentage = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.scst_target_driver = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.storage_protocol = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.target_helper = lioadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.target_ip_address = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.target_port = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.target_protocol = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.trace_flags = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.use_chap_auth = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.volume_clear = zero {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.volume_clear_size = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] lvmdriver-1.volumes_dir = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.ssl = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.ssl_version = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_notifications.driver = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_notifications.retry = -1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] oslo_messaging_notifications.transport_url = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] key_manager.fixed_key = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.barbican_api_version = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.barbican_endpoint = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.barbican_endpoint_type = public {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.barbican_region_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.cafile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.collect_timing = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.insecure = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.number_of_retries = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.retry_delay = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.send_service_user_token = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.split_loggers = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.tls_ciphers = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.tls_min_version = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.verify_ssl = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican.verify_ssl_path = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican_service_user.auth_section = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican_service_user.auth_type = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican_service_user.cafile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican_service_user.certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican_service_user.collect_timing = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican_service_user.insecure = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican_service_user.keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican_service_user.split_loggers = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican_service_user.timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican_service_user.tls_ciphers = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] barbican_service_user.tls_min_version = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.approle_role_id = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.approle_secret_id = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.auth_method = approle {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.auth_path = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.kv_mountpoint = secret {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.kv_path = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.kv_version = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.namespace = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.root_token_id = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.ssl_ca_crt_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.timeout = 60.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.token_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.token_role = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.use_ssl = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:32:17 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] ******************************************************************************** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 10:32:17 devstack sudo[76104]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:17 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:17 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:17 devstack sudo[76192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:32:17 devstack sudo[76192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:17 devstack sudo[76192]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:17 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.277s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:17 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:32:17 devstack cinder-volume[76046]: INFO cinder.brick.local_dev.lvm [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 10:32:17 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:17 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:17 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:17 devstack sudo[76282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:32:17 devstack sudo[76282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:18 devstack sudo[76282]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:18 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:18 devstack cinder-volume[76046]: DEBUG cinder.brick.local_dev.lvm [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76046) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 25 10:32:18 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:18 devstack sudo[76395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:32:18 devstack sudo[76395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:19 devstack sudo[76395]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:19 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.793s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:19 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:19 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:19 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:19 devstack sudo[76736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:32:19 devstack sudo[76736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:20 devstack sudo[76736]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:20 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.334s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:20 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:20 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:20 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:20 devstack sudo[76776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 10:32:20 devstack sudo[76776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:20 devstack sudo[76776]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:20 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.272s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:20 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:20 devstack sudo[76779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:32:20 devstack sudo[76779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:20 devstack sudo[76779]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:20 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:20 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:20 devstack sudo[76782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:32:20 devstack sudo[76782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:21 devstack sudo[76782]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:21 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:21 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:21 devstack sudo[76785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:32:21 devstack sudo[76785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:21 devstack sudo[76785]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:21 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:21 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:21 devstack sudo[76788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:32:21 devstack sudo[76788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:21 devstack sudo[76788]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:21 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.308s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:21 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:21 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:21 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:21 devstack sudo[76793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:32:21 devstack sudo[76793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:21 devstack sudo[76793]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:21 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:21 devstack cinder-volume[76046]: INFO cinder.volume.drivers.lvm [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 10:32:21 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:21 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:21 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:21 devstack sudo[76797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:32:21 devstack sudo[76797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:22 devstack sudo[76797]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:22 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:22 devstack cinder-volume[76046]: DEBUG cinder.volume.drivers.lvm [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Updating volume stats {{(pid=76046) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 10:32:22 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:22 devstack sudo[76801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:32:22 devstack sudo[76801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:22 devstack sudo[76801]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:22 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:22 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:22 devstack sudo[76805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:32:22 devstack sudo[76805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:22 devstack sudo[76805]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:22 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:22 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:22 devstack sudo[76808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:32:22 devstack sudo[76808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:23 devstack sudo[76808]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:23 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:23 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:23 devstack sudo[76814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:32:23 devstack sudo[76814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:23 devstack sudo[76814]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:23 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.383s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:23 devstack cinder-volume[76046]: INFO cinder.volume.driver [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Driver hasn't implemented _init_vendor_properties() Sep 25 10:32:23 devstack cinder-volume[76046]: DEBUG cinder.volume.driver [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76046) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 10:32:23 devstack cinder-volume[76046]: DEBUG oslo_db.sqlalchemy.engines [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:32:23 devstack cinder-volume[76046]: DEBUG dbcounter [-] [76046] Writer thread running {{(pid=76046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 10:32:23 devstack cinder-volume[76046]: DEBUG cinder.db.api [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Building query based on filter {{(pid=76046) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 10:32:23 devstack cinder-volume[76046]: DEBUG cinder.image.image_utils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76046) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 10:32:23 devstack cinder-volume[76046]: INFO cinder.keymgr.migration [None req-c2758597-7ee1-41a4-bcd4-3610fa19b42c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 10:32:23 devstack cinder-volume[76046]: DEBUG cinder.volume.drivers.lvm [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Updating volume stats {{(pid=76046) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 10:32:23 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:23 devstack sudo[76820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:32:23 devstack sudo[76820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:23 devstack sudo[76820]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:23 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:23 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:23 devstack sudo[76823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:32:23 devstack sudo[76823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:24 devstack sudo[76823]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:24 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:24 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:24 devstack sudo[76826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:32:24 devstack sudo[76826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:24 devstack sudo[76826]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:24 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:24 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:24 devstack sudo[76829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:32:24 devstack sudo[76829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:24 devstack sudo[76829]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:24 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:24 devstack cinder-volume[76046]: DEBUG cinder.manager [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Notifying Schedulers of capabilities ... {{(pid=76046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:32:24 devstack cinder-volume[76046]: INFO cinder.volume.manager [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Driver initialization completed successfully. Sep 25 10:32:24 devstack cinder-volume[76046]: INFO cinder.manager [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Initiating service 2 cleanup Sep 25 10:32:24 devstack cinder-volume[76046]: INFO cinder.manager [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Service 2 cleanup completed. Sep 25 10:32:24 devstack cinder-volume[76046]: DEBUG cinder.service [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Creating RPC server for service cinder-volume {{(pid=76046) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 10:32:24 devstack cinder-volume[76046]: DEBUG cinder.service [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76046) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 10:32:24 devstack cinder-volume[76046]: INFO cinder.volume.manager [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 10:32:24 devstack cinder-volume[76046]: DEBUG cinder.volume.drivers.lvm [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Updating volume stats {{(pid=76046) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 10:32:24 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:24 devstack sudo[76832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:32:24 devstack sudo[76832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:25 devstack sudo[76832]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:25 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:25 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:25 devstack sudo[76836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:32:25 devstack sudo[76836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:25 devstack sudo[76836]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:25 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:25 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:25 devstack sudo[76842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:32:25 devstack sudo[76842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:25 devstack sudo[76842]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:25 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.411s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:25 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:25 devstack sudo[76849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:32:25 devstack sudo[76849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:26 devstack sudo[76849]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:26 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:26 devstack cinder-volume[76046]: INFO cinder.volume.manager [None req-11d87c7c-8937-49fc-92d7-8eb90aa84cbd None None] Driver post RPC initialization completed successfully. Sep 25 10:32:26 devstack cinder-volume[75845]: DEBUG dbcounter [-] [75845] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75845) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:32:34 devstack cinder-volume[76046]: DEBUG dbcounter [-] [76046] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:32:36 devstack cinder-volume[76046]: DEBUG dbcounter [-] [76046] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=76046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:32:51 devstack cinder-volume[76046]: DEBUG oslo_service.periodic_task [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running periodic task VolumeManager._thread_info {{(pid=76046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:32:51 devstack cinder-volume[76046]: DEBUG cinder.volume.manager [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] thread count: 6 {{(pid=76046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:32:51 devstack cinder-volume[76046]: DEBUG cinder.volume.manager [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] thread info: [<_MainThread(MainThread, started 127797670379648)>, , , , , ] {{(pid=76046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:33:51 devstack cinder-volume[76046]: DEBUG oslo_service.periodic_task [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:33:51 devstack cinder-volume[76046]: DEBUG cinder.volume.drivers.lvm [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Updating volume stats {{(pid=76046) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 10:33:51 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:33:51 devstack sudo[79508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:33:51 devstack sudo[79508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:33:51 devstack sudo[79508]: pam_unix(sudo:session): session closed for user root Sep 25 10:33:51 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:33:51 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:33:51 devstack sudo[79511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:33:51 devstack sudo[79511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:33:52 devstack sudo[79511]: pam_unix(sudo:session): session closed for user root Sep 25 10:33:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:33:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:33:52 devstack sudo[79516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:33:52 devstack sudo[79516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:33:52 devstack sudo[79516]: pam_unix(sudo:session): session closed for user root Sep 25 10:33:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:33:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:33:52 devstack sudo[79519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:33:52 devstack sudo[79519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:33:52 devstack sudo[79519]: pam_unix(sudo:session): session closed for user root Sep 25 10:33:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:33:52 devstack cinder-volume[76046]: DEBUG cinder.manager [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Notifying Schedulers of capabilities ... {{(pid=76046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:33:52 devstack cinder-volume[76046]: DEBUG oslo_service.periodic_task [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running periodic task VolumeManager._thread_info {{(pid=76046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:33:52 devstack cinder-volume[76046]: DEBUG cinder.volume.manager [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] thread count: 6 {{(pid=76046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:33:52 devstack cinder-volume[76046]: DEBUG cinder.volume.manager [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] thread info: [<_MainThread(MainThread, started 127797670379648)>, , , , , ] {{(pid=76046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:34:36 devstack cinder-volume[76046]: DEBUG dbcounter [-] [76046] Writing DB stats cinder:SELECT=1 {{(pid=76046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:34:36 devstack cinder-volume[76046]: DEBUG dbcounter [-] [76046] Writing DB stats cinder:UPDATE=1 {{(pid=76046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:34:51 devstack cinder-volume[76046]: DEBUG oslo_service.periodic_task [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:34:51 devstack cinder-volume[76046]: DEBUG cinder.volume.drivers.lvm [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Updating volume stats {{(pid=76046) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 10:34:51 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:51 devstack sudo[82496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:34:51 devstack sudo[82496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:51 devstack sudo[82496]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:51 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:51 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:51 devstack sudo[82503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:34:51 devstack sudo[82503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:51 devstack sudo[82503]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:51 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:51 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:52 devstack sudo[82509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:34:52 devstack sudo[82509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:52 devstack sudo[82509]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:52 devstack sudo[82512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:34:52 devstack sudo[82512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:52 devstack sudo[82512]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:52 devstack cinder-volume[76046]: DEBUG cinder.manager [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Notifying Schedulers of capabilities ... {{(pid=76046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:34:52 devstack cinder-volume[76046]: DEBUG oslo_service.periodic_task [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running periodic task VolumeManager._thread_info {{(pid=76046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:34:52 devstack cinder-volume[76046]: DEBUG cinder.volume.manager [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] thread count: 6 {{(pid=76046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:34:52 devstack cinder-volume[76046]: DEBUG cinder.volume.manager [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] thread info: [<_MainThread(MainThread, started 127797670379648)>, , , , , ] {{(pid=76046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:35:51 devstack cinder-volume[76046]: DEBUG oslo_service.periodic_task [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:35:51 devstack cinder-volume[76046]: DEBUG cinder.volume.drivers.lvm [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Updating volume stats {{(pid=76046) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 10:35:51 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:35:51 devstack sudo[84467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:35:51 devstack sudo[84467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:35:51 devstack sudo[84467]: pam_unix(sudo:session): session closed for user root Sep 25 10:35:51 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:35:51 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:35:51 devstack sudo[84499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:35:51 devstack sudo[84499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:35:52 devstack sudo[84499]: pam_unix(sudo:session): session closed for user root Sep 25 10:35:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:35:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:35:52 devstack sudo[84518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:35:52 devstack sudo[84518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:35:52 devstack sudo[84518]: pam_unix(sudo:session): session closed for user root Sep 25 10:35:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:35:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:35:52 devstack sudo[84521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:35:52 devstack sudo[84521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:35:52 devstack sudo[84521]: pam_unix(sudo:session): session closed for user root Sep 25 10:35:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:35:52 devstack cinder-volume[76046]: DEBUG cinder.manager [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Notifying Schedulers of capabilities ... {{(pid=76046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:35:52 devstack cinder-volume[76046]: DEBUG oslo_service.periodic_task [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running periodic task VolumeManager._thread_info {{(pid=76046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:35:52 devstack cinder-volume[76046]: DEBUG cinder.volume.manager [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] thread count: 6 {{(pid=76046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:35:52 devstack cinder-volume[76046]: DEBUG cinder.volume.manager [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] thread info: [<_MainThread(MainThread, started 127797670379648)>, , , , , ] {{(pid=76046) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:36:36 devstack cinder-volume[76046]: DEBUG dbcounter [-] [76046] Writing DB stats cinder:SELECT=1 {{(pid=76046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:36:36 devstack cinder-volume[76046]: DEBUG dbcounter [-] [76046] Writing DB stats cinder:UPDATE=1 {{(pid=76046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:36:51 devstack cinder-volume[76046]: DEBUG oslo_service.periodic_task [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76046) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:36:51 devstack cinder-volume[76046]: DEBUG cinder.volume.drivers.lvm [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Updating volume stats {{(pid=76046) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 10:36:51 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:51 devstack sudo[85507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:36:51 devstack sudo[85507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:51 devstack sudo[85507]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:51 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:51 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:51 devstack sudo[85510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:36:51 devstack sudo[85510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:52 devstack sudo[85510]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:52 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:36:52 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:52 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.341s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:52 devstack sudo[85541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:36:52 devstack sudo[85541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:52 devstack sudo[85541]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:52 devstack cinder-volume[76046]: DEBUG oslo_concurrency.processutils [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.338s {{(pid=76046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:52 devstack cinder-volume[76046]: DEBUG cinder.manager [None req-fe9c8780-39e8-45fb-9029-4d7707d1ddf6 None None] Notifying Schedulers of capabilities ... {{(pid=76046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:14 devstack cinder-volume[75845]: INFO oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Caught SIGTERM, stopping children Sep 25 10:37:14 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Acquiring lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 10:37:14 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Acquired lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 10:37:14 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Releasing lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 10:37:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Stop services. {{(pid=75845) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 10:37:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Killing children. {{(pid=75845) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 10:37:14 devstack cinder-volume[75845]: INFO oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Waiting on 1 children to exit Sep 25 10:37:14 devstack cinder-volume[76046]: DEBUG oslo_concurrency.lockutils [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Acquiring lock "singleton_lock" {{(pid=76046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 10:37:14 devstack cinder-volume[76046]: DEBUG oslo_concurrency.lockutils [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Acquired lock "singleton_lock" {{(pid=76046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 10:37:14 devstack cinder-volume[76046]: DEBUG oslo_concurrency.lockutils [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Releasing lock "singleton_lock" {{(pid=76046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 10:37:14 devstack cinder-volume[76046]: WARNING amqp [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 10:37:14 devstack cinder-volume[76046]: WARNING amqp [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 10:37:14 devstack cinder-volume[75845]: INFO oslo_service.backend._eventlet.service [None req-3956234b-688c-4d17-bbfd-9847d6b77bfe None None] Child 76046 exited with status 0 Sep 25 10:37:15 devstack cinder-volume[86059]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 10:37:15 devstack cinder-volume[86059]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 10:37:15 devstack cinder-volume[86059]: we strongly recommend against using it for new projects. Sep 25 10:37:15 devstack cinder-volume[86059]: If you are already using Eventlet, we recommend migrating to a different Sep 25 10:37:15 devstack cinder-volume[86059]: framework. For more detail see Sep 25 10:37:15 devstack cinder-volume[86059]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 10:37:15 devstack cinder-volume[86059]: import eventlet # noqa Sep 25 10:37:17 devstack cinder-volume[86059]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 10:37:17 devstack cinder-volume[86059]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 10:37:17 devstack cinder-volume[86059]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 10:37:18 devstack cinder-volume[86059]: INFO dbcounter [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Registered counter for database cinder Sep 25 10:37:18 devstack cinder-volume[86059]: DEBUG oslo_db.sqlalchemy.engines [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86059) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:37:18 devstack cinder-volume[86059]: DEBUG dbcounter [-] [86059] Writer thread running {{(pid=86059) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 10:37:19 devstack cinder-volume[86059]: INFO cinder.rpc [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 10:37:19 devstack cinder-volume[86059]: INFO cinder.rpc [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_db.sqlalchemy.engines [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86059) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:37:19 devstack cinder-volume[86059]: INFO cinder.volume.manager [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Determined volume DB was empty at startup. Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG cinder.volume.manager [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86059) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 10:37:19 devstack cinder-volume[86059]: INFO cinder.volume.manager [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 10:37:19 devstack cinder-volume[86059]: WARNING stevedore.named [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 10:37:19 devstack cinder-volume[86059]: WARNING castellan.key_manager [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 10:37:19 devstack cinder-volume[86059]: WARNING cinder.keymgr.conf_key_mgr [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 10:37:19 devstack cinder-volume[86059]: INFO cinder.volume.manager [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_db.sqlalchemy.engines [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86059) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:37:19 devstack cinder-volume[86059]: INFO oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Starting 1 workers Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Started child 86274 {{(pid=86059) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Full set of CONF: {{(pid=86059) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] ******************************************************************************** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Configuration options gathered from: {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] ================================================================================ {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] allow_availability_zone_fallback = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86274]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] allow_compression_on_image_upload = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] allowed_direct_url_schemes = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] api_rate_limit = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] auth_strategy = keystone {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_availability_zone = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_host = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_stats_polling_interval = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backup_api_class = cinder.backup.api.API {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backup_name_template = backup-%s {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backup_use_same_host = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backup_use_temp_snapshot = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] chap_password = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] chap_username = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cinder_internal_tenant_project_id = 3e60a60cfca44d0cac2a0b4c0e5c9d50 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cinder_internal_tenant_user_id = 6c682b26dc244663a9ea4dfec5b744b4 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cluster = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] compression_format = gzip {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] compute_api_class = cinder.compute.nova.API {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] config_dir = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] config_source = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] control_exchange = openstack {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] debug = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] default_availability_zone = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] default_group_type = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] default_volume_type = QuobyteHD {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] disk_geometry = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] driver_client_cert = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] driver_client_cert_key = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] driver_data_namespace = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] driver_ssl_cert_path = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] driver_ssl_cert_verify = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] driver_use_ssl = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] enable_new_services = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] enable_unsupported_driver = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] enabled_backends = ['QuobyteHD'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] enforce_multipath_for_image_xfer = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] filter_function = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance_api_insecure = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance_api_ssl_compression = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance_ca_certificates_file = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance_catalog_info = image:glance:publicURL {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance_certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance_keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance_num_retries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance_request_timeout = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] goodness_function = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] graceful_shutdown_timeout = 5 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] group_api_class = cinder.group.api.API {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] host = devstack {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] image_compress_on_upload = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] image_conversion_address_space_limit = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] image_conversion_cpu_limit = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] image_conversion_disable = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] image_introspection_address_space_limit = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] image_introspection_cpu_limit = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] image_upload_use_cinder_backend = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] image_upload_use_internal_tenant = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] image_volume_cache_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] image_volume_cache_max_count = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] image_volume_cache_max_size_gb = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] init_host_max_objects_retrieval = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] instance_format = [instance: %(uuid)s] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] iscsi_target_flags = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] iscsi_write_cache = on {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] iser_helper = tgtadm {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] iser_ip_address = 192.168.122.136 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] iser_port = 3260 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86274]: INFO cinder.volume.manager [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 10:37:19 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.remotefs [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86274) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] log_color = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] log_config_append = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] log_dir = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] log_file = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] log_options = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] log_rotate_interval = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] log_rotate_interval_type = days {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] log_rotation_type = none {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] max_age = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] max_logfile_count = 30 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] max_logfile_size_mb = 200 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] max_over_subscription_ratio = 20.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] message_reap_interval = 86400 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] message_ttl = 2592000 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] migration_create_volume_timeout_secs = 300 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] monkey_patch = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] monkey_patch_modules = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] my_ip = 192.168.122.136 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] no_snapshot_gb_quota = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] num_iser_scan_tries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] num_shell_tries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] num_volume_device_scan_tries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] nvmeof_conn_info_version = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] nvmet_ns_id = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] nvmet_port_id = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] osapi_max_limit = 1000 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] osapi_volume_ext_list = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] osapi_volume_listen_port = 8776 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] osapi_volume_use_ssl = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] osapi_volume_workers = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] per_volume_size_limit = -1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] periodic_fuzzy_delay = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] periodic_interval = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] public_endpoint = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] publish_errors = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] quota_backup_gigabytes = 1000 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] quota_backups = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] quota_gigabytes = 1000 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] quota_groups = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] quota_snapshots = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] quota_volumes = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] rate_limit_burst = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] rate_limit_except_level = CRITICAL {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] rate_limit_interval = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] reinit_driver_count = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] replication_device = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] report_discard_supported = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] report_interval = 120 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] reservation_clean_interval = 86400 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] reservation_expire = 86400 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] reserved_image_namespaces = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] reserved_percentage = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] rpc_response_timeout = 120 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] run_external_periodic_tasks = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] scst_target_driver = iscsi {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] scst_target_iqn_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] service_down_time = 720 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] shell_completion = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] snapshot_name_template = snapshot-%s {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] split_loggers = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] state_path = /opt/stack/data/cinder {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] storage_availability_zone = nova {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] storage_protocol = iSCSI {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] syslog_log_facility = LOG_USER {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] target_helper = lioadm {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] target_ip_address = 192.168.122.136 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] target_port = 3260 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] target_protocol = iscsi {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] target_secondary_ip_addresses = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] trace_flags = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] transport_url = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] until_refresh = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] use_chap_auth = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] use_default_quota_class = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] use_journal = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] use_json = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] use_multipath_for_image_xfer = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] use_stderr = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] use_syslog = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] verify_glance_signatures = enabled {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] volume_api_class = cinder.volume.api.API {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] volume_backend_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] volume_clear = zero {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] volume_clear_ionice = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] volume_clear_size = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] volume_copy_bps_limit = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] volume_dd_blocksize = 1M {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] volume_name_template = volume-%s {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] volume_service_inithost_offload = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] volume_usage_audit_period = month {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86274) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] zoning_mode = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_concurrency.disable_process_locking = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86274]: WARNING cinder.volume.drivers.quobyte [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 10:37:19 devstack cinder-volume[86274]: WARNING cinder.volume.drivers.quobyte [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Running cmd (subprocess): mount.quobyte {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.auth_section = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.auth_type = password {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.auth_version = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.cache = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.include_service_catalog = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.insecure = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.interface = public {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_password = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcache_username = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.region_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.service_type = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.backend = dogpile.cache.null {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.backend_argument = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.backend_expiration_time = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.config_prefix = cache.oslo {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.debug_cache_backend = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.enable_retry_client = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.enable_socket_keepalive = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.expiration_time = 600 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.hashclient_retry_attempts = 2 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.memcache_dead_retry = 300 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.memcache_pool_maxsize = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.memcache_sasl_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.password = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.proxies = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.redis_db = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.redis_server = localhost:6379 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.retry_attempts = 2 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.retry_delay = 0.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.socket_keepalive_count = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.socket_keepalive_idle = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.socket_keepalive_interval = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.socket_timeout = 1.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.tls_allowed_ciphers = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.tls_cafile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.tls_certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.tls_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.tls_keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cache.username = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] coordination.backend_url = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.asyncio_connection = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.asyncio_slave_connection = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.backend = sqlalchemy {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.connection = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.connection_debug = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.connection_parameters = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.connection_recycle_time = 3600 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.connection_trace = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.db_inc_retry_interval = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.db_max_retries = 20 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.db_max_retry_interval = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.db_retry_interval = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.max_overflow = 50 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.max_pool_size = 5 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.max_retries = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.mysql_wsrep_sync_wait = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.pool_timeout = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.retry_interval = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.slave_connection = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.sqlite_synchronous = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.synchronous_reader = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] database.use_db_reconnect = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_tracing.insecure = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] profiler.connection_string = messaging:// {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] profiler.enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] profiler.es_doc_type = notification {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] profiler.es_scroll_size = 10000 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] profiler.es_scroll_time = 2m {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] profiler.filter_error_trace = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] profiler.hmac_keys = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] profiler.sentinel_service_name = mymaster {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] profiler.socket_timeout = 0.1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] profiler.trace_requests = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] profiler.trace_sqlalchemy = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] profiler_jaeger.process_tags = {} {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] profiler_jaeger.service_name_prefix = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] profiler_otlp.service_name_prefix = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_policy.enforce_new_defaults = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_policy.policy_default_rule = default {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_policy.policy_file = policy.yaml {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack quobyte-client[86279]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 10:37:19 devstack quobyte-client[86279]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] privsep_osbrick.group = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] privsep_osbrick.helper_command = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] privsep_osbrick.user = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] CMD "mount.quobyte" returned: 1 in 0.103s {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:19 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:19 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:19 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86274) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cinder_sys_admin.group = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cinder_sys_admin.helper_command = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] cinder_sys_admin.user = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] service_user.auth_section = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] service_user.auth_type = password {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] service_user.cafile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] service_user.certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86274]: INFO cinder.volume.drivers.quobyte [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 ... Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] service_user.collect_timing = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] service_user.insecure = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc -c /etc/quobyte/client-cinder.cfg {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] service_user.keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] service_user.send_service_user_token = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] service_user.split_loggers = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] service_user.timeout = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] service_user.tls_ciphers = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] service_user.tls_min_version = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance.auth_section = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance.auth_type = password {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance.certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance.collect_timing = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance.insecure = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance.keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance.region_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance.split_loggers = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance.timeout = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance.tls_ciphers = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] glance.tls_min_version = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.backend_availability_zone = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.chap_password = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.chap_username = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.disk_geometry = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.driver_client_cert = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.driver_client_cert_key = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.driver_data_namespace = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.driver_use_ssl = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.extra_capabilities = {} {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.filter_function = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.goodness_function = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.iscsi_target_flags = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.iscsi_write_cache = on {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.iser_helper = tgtadm {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.iser_port = 3260 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.nas_host = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.nas_login = admin {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.nas_mount_options = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.nas_password = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.nas_private_key = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.nas_share_path = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.num_shell_tries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.quobyte_volume_url = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.replication_device = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.report_discard_supported = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.reserved_percentage = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.target_helper = tgtadm {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.target_port = 3260 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.target_protocol = iscsi {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.trace_flags = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.unique_fqdn_network = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.use_chap_auth = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.volume_backend_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.volume_clear = zero {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.volume_clear_ionice = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.volume_clear_size = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_reports.file_event_handler = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_reports.log_dir = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.backend_availability_zone = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.backend_host = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.chap_password = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack sudo[86280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc -c /etc/quobyte/client-cinder.cfg Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.chap_username = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.chiscsi_conf = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.disk_geometry = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.driver_client_cert = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.driver_data_namespace = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.driver_use_ssl = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.extra_capabilities = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.filter_function = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.goodness_function = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.iser_helper = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.iser_ip_address = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.iser_port = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.iser_target_prefix = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.nas_host = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.nas_login = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.nas_mount_options = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.nas_password = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.nas_private_key = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.nas_share_path = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.nas_ssh_port = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.num_shell_tries = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.nvmet_port_id = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.replication_device = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.report_discard_supported = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.reserved_percentage = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.scst_target_driver = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.storage_protocol = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.target_helper = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.target_ip_address = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.target_port = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.target_prefix = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.target_protocol = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.trace_flags = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.use_chap_auth = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.volume_clear = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.volume_clear_size = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] QuobyteHD.volumes_dir = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.ssl = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_notifications.driver = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_notifications.retry = -1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] key_manager.fixed_key = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.barbican_api_version = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.barbican_endpoint = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.barbican_endpoint_type = public {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.barbican_region_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.cafile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.collect_timing = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.insecure = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.number_of_retries = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.retry_delay = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.send_service_user_token = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.split_loggers = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.timeout = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.tls_ciphers = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.tls_min_version = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.verify_ssl = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican.verify_ssl_path = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican_service_user.auth_section = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican_service_user.auth_type = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican_service_user.cafile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican_service_user.certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican_service_user.collect_timing = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican_service_user.insecure = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican_service_user.keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican_service_user.split_loggers = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican_service_user.timeout = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican_service_user.tls_ciphers = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] barbican_service_user.tls_min_version = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.approle_role_id = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.approle_secret_id = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.auth_method = approle {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.auth_path = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.kv_mountpoint = secret {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.kv_path = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.kv_version = 2 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.namespace = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.root_token_id = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.ssl_ca_crt_file = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.timeout = 60.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.token_file = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.token_role = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.use_ssl = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:19 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] ******************************************************************************** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 10:37:20 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.498s {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:20 devstack cinder-volume[86274]: INFO cinder.volume.drivers.quobyte [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 succeeded Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86274) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.514s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:20 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:37:20 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:20 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.257s {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:20 devstack cinder-volume[86274]: INFO cinder.volume.driver [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Driver hasn't implemented _init_vendor_properties() Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG cinder.volume.driver [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4541511535645, 'free_capacity_gb': 1775.4541511535645, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86274) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG oslo_db.sqlalchemy.engines [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86274) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG dbcounter [-] [86274] Writer thread running {{(pid=86274) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG cinder.db.api [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Building query based on filter {{(pid=86274) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG cinder.image.image_utils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86274) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 10:37:20 devstack cinder-volume[86274]: INFO cinder.keymgr.migration [None req-b9c83546-4461-46c9-afd0-c07eacc6c3b0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86274) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86274) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:20 devstack sudo[86382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:37:20 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:20 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.235s {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG cinder.manager [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Notifying Schedulers of capabilities ... {{(pid=86274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:20 devstack cinder-volume[86274]: INFO cinder.volume.manager [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Driver initialization completed successfully. Sep 25 10:37:20 devstack cinder-volume[86274]: INFO cinder.manager [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Initiating service 3 cleanup Sep 25 10:37:20 devstack cinder-volume[86274]: INFO cinder.manager [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Service 3 cleanup completed. Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG cinder.service [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Creating RPC server for service cinder-volume {{(pid=86274) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG cinder.service [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86274) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 10:37:20 devstack cinder-volume[86274]: INFO cinder.volume.manager [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:20 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86274) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:21 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86274) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:21 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:21 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:21 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:37:21 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:21 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:21 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.314s {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:21 devstack cinder-volume[86274]: INFO cinder.volume.manager [None req-45b5ca64-1dbb-4842-8523-7000bd5daa2c None None] Driver post RPC initialization completed successfully. Sep 25 10:37:26 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-6fb852f5-73bc-4ce1-9781-5b93a06324dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:26 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-6fb852f5-73bc-4ce1-9781-5b93a06324dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:26 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-6fb852f5-73bc-4ce1-9781-5b93a06324dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86274) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:26 devstack cinder-volume[86274]: DEBUG cinder.volume.drivers.quobyte [None req-6fb852f5-73bc-4ce1-9781-5b93a06324dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86274) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:26 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-6fb852f5-73bc-4ce1-9781-5b93a06324dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86274) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:26 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-6fb852f5-73bc-4ce1-9781-5b93a06324dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:26 devstack sudo[86505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:37:26 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:26 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:26 devstack cinder-volume[86274]: DEBUG oslo_concurrency.processutils [None req-6fb852f5-73bc-4ce1-9781-5b93a06324dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.317s {{(pid=86274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:26 devstack cinder-volume[86274]: DEBUG cinder.manager [None req-6fb852f5-73bc-4ce1-9781-5b93a06324dc None None] Notifying Schedulers of capabilities ... {{(pid=86274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:27 devstack cinder-volume[86059]: INFO oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Caught SIGTERM, stopping children Sep 25 10:37:27 devstack cinder-volume[86059]: DEBUG oslo_concurrency.lockutils [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Acquiring lock "singleton_lock" {{(pid=86059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 10:37:27 devstack cinder-volume[86059]: DEBUG oslo_concurrency.lockutils [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Acquired lock "singleton_lock" {{(pid=86059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 10:37:27 devstack cinder-volume[86059]: DEBUG oslo_concurrency.lockutils [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Releasing lock "singleton_lock" {{(pid=86059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 10:37:27 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Stop services. {{(pid=86059) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 10:37:27 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Killing children. {{(pid=86059) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 10:37:27 devstack cinder-volume[86059]: INFO oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Waiting on 1 children to exit Sep 25 10:37:29 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Acquiring lock "singleton_lock" {{(pid=86274) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 10:37:29 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Acquired lock "singleton_lock" {{(pid=86274) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 10:37:29 devstack cinder-volume[86274]: DEBUG oslo_concurrency.lockutils [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Releasing lock "singleton_lock" {{(pid=86274) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 10:37:29 devstack cinder-volume[86274]: WARNING amqp [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 10:37:29 devstack cinder-volume[86274]: WARNING amqp [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 10:37:29 devstack cinder-volume[86059]: INFO oslo_service.backend._eventlet.service [None req-6067a949-81e5-4cb4-b050-e98117febd27 None None] Child 86274 exited with status 0 Sep 25 10:37:29 devstack cinder-volume[86581]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 10:37:29 devstack cinder-volume[86581]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 10:37:29 devstack cinder-volume[86581]: we strongly recommend against using it for new projects. Sep 25 10:37:29 devstack cinder-volume[86581]: If you are already using Eventlet, we recommend migrating to a different Sep 25 10:37:29 devstack cinder-volume[86581]: framework. For more detail see Sep 25 10:37:29 devstack cinder-volume[86581]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 10:37:29 devstack cinder-volume[86581]: import eventlet # noqa Sep 25 10:37:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 10:37:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 10:37:33 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 10:37:34 devstack cinder-volume[86581]: INFO dbcounter [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] Registered counter for database cinder Sep 25 10:37:34 devstack cinder-volume[86581]: DEBUG oslo_db.sqlalchemy.engines [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writer thread running {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 10:37:35 devstack cinder-volume[86581]: INFO cinder.rpc [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 10:37:35 devstack cinder-volume[86581]: INFO cinder.rpc [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_db.sqlalchemy.engines [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:37:35 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] Determined volume DB was empty at startup. Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG cinder.volume.manager [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86581) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 10:37:35 devstack cinder-volume[86581]: WARNING stevedore.named [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 10:37:35 devstack cinder-volume[86581]: WARNING castellan.key_manager [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 10:37:35 devstack cinder-volume[86581]: WARNING cinder.keymgr.conf_key_mgr [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 10:37:35 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_db.sqlalchemy.engines [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:37:35 devstack cinder-volume[86581]: INFO oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] Starting 1 workers Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] Started child 86874 {{(pid=86581) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] Full set of CONF: {{(pid=86581) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] ******************************************************************************** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] Configuration options gathered from: {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] ================================================================================ {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] allow_availability_zone_fallback = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] allow_compression_on_image_upload = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] allowed_direct_url_schemes = [] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86874]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] api_rate_limit = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] auth_strategy = keystone {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_availability_zone = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_host = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_name = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_stats_polling_interval = 60 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backup_api_class = cinder.backup.api.API {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backup_name_template = backup-%s {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backup_use_same_host = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backup_use_temp_snapshot = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] chap_password = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] chap_username = {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cinder_internal_tenant_project_id = 3e60a60cfca44d0cac2a0b4c0e5c9d50 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cinder_internal_tenant_user_id = 6c682b26dc244663a9ea4dfec5b744b4 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cluster = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] compression_format = gzip {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] compute_api_class = cinder.compute.nova.API {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] config_dir = [] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] config_source = [] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] control_exchange = openstack {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] debug = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] default_availability_zone = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] default_group_type = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] default_volume_type = QuobyteHD {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] disk_geometry = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 10:37:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86874) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] driver_client_cert = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] driver_client_cert_key = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] driver_data_namespace = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] driver_ssl_cert_path = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] driver_ssl_cert_verify = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] driver_use_ssl = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] enable_new_services = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] enable_unsupported_driver = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] enabled_backends = ['QuobyteHD'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] enforce_multipath_for_image_xfer = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] filter_function = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance_api_insecure = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance_api_ssl_compression = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance_ca_certificates_file = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance_catalog_info = image:glance:publicURL {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance_certfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance_keyfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance_num_retries = 3 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance_request_timeout = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] goodness_function = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] graceful_shutdown_timeout = 5 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] group_api_class = cinder.group.api.API {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] host = devstack {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] image_compress_on_upload = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] image_conversion_address_space_limit = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] image_conversion_cpu_limit = 60 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] image_conversion_disable = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] image_introspection_address_space_limit = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] image_introspection_cpu_limit = 60 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] image_upload_use_cinder_backend = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] image_upload_use_internal_tenant = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] image_volume_cache_enabled = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] image_volume_cache_max_count = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] image_volume_cache_max_size_gb = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] init_host_max_objects_retrieval = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] instance_format = [instance: %(uuid)s] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] iscsi_target_flags = {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] iscsi_write_cache = on {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] iser_helper = tgtadm {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] iser_ip_address = 192.168.122.136 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] iser_port = 3260 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] log_color = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] log_config_append = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] log_dir = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] log_file = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] log_options = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] log_rotate_interval = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] log_rotate_interval_type = days {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] log_rotation_type = none {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] max_age = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] max_logfile_count = 30 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] max_logfile_size_mb = 200 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] max_over_subscription_ratio = 20.0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] message_reap_interval = 86400 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] message_ttl = 2592000 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] migration_create_volume_timeout_secs = 300 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] monkey_patch = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] monkey_patch_modules = [] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] my_ip = 192.168.122.136 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] no_snapshot_gb_quota = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] num_iser_scan_tries = 3 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] num_shell_tries = 3 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] num_volume_device_scan_tries = 3 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] nvmeof_conn_info_version = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] nvmet_ns_id = 10 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] nvmet_port_id = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] osapi_max_limit = 1000 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] osapi_volume_ext_list = [] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] osapi_volume_listen_port = 8776 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] osapi_volume_use_ssl = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] osapi_volume_workers = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] per_volume_size_limit = -1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] periodic_fuzzy_delay = 60 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] periodic_interval = 60 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] public_endpoint = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] publish_errors = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] quota_backup_gigabytes = 1000 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] quota_backups = 10 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] quota_gigabytes = 1000 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] quota_groups = 10 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] quota_snapshots = 10 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] quota_volumes = 10 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] rate_limit_burst = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] rate_limit_except_level = CRITICAL {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] rate_limit_interval = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] reinit_driver_count = 3 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] replication_device = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] report_discard_supported = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] report_interval = 120 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] reservation_clean_interval = 86400 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] reservation_expire = 86400 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] reserved_image_namespaces = [] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] reserved_percentage = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] rpc_response_timeout = 120 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] run_external_periodic_tasks = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] scst_target_driver = iscsi {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] scst_target_iqn_name = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] service_down_time = 720 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] shell_completion = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] snapshot_name_template = snapshot-%s {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] split_loggers = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] state_path = /opt/stack/data/cinder {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] storage_availability_zone = nova {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] storage_protocol = iSCSI {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] syslog_log_facility = LOG_USER {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] target_helper = lioadm {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] target_ip_address = 192.168.122.136 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] target_port = 3260 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] target_protocol = iscsi {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] target_secondary_ip_addresses = [] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] trace_flags = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] transport_url = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] until_refresh = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] use_chap_auth = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] use_default_quota_class = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] use_journal = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] use_json = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] use_multipath_for_image_xfer = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] use_stderr = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] use_syslog = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] verify_glance_signatures = enabled {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] volume_api_class = cinder.volume.api.API {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] volume_backend_name = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] volume_clear = zero {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] volume_clear_ionice = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] volume_clear_size = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] volume_copy_bps_limit = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] volume_dd_blocksize = 1M {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] volume_name_template = volume-%s {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] volume_service_inithost_offload = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] volume_usage_audit_period = month {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] zoning_mode = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_concurrency.disable_process_locking = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:35 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86874) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 10:37:36 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.quobyte [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 10:37:36 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.quobyte [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.auth_section = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.auth_type = password {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.auth_version = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.cache = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Running cmd (subprocess): mount.quobyte {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.certfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.include_service_catalog = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.insecure = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.interface = public {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.keyfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_password = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcache_username = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.region_name = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.service_type = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.backend = dogpile.cache.null {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.backend_argument = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.backend_expiration_time = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.config_prefix = cache.oslo {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.debug_cache_backend = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.enable_retry_client = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.enable_socket_keepalive = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.enabled = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.expiration_time = 600 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.hashclient_retry_attempts = 2 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.memcache_dead_retry = 300 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.memcache_pool_maxsize = 10 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.memcache_sasl_enabled = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.password = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.proxies = [] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.redis_db = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.redis_server = localhost:6379 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.retry_attempts = 2 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.retry_delay = 0.0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.socket_keepalive_count = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.socket_keepalive_idle = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.socket_keepalive_interval = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.socket_timeout = 1.0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.tls_allowed_ciphers = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.tls_cafile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.tls_certfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.tls_enabled = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.tls_keyfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cache.username = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] coordination.backend_url = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.asyncio_connection = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.asyncio_slave_connection = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.backend = sqlalchemy {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.connection = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.connection_debug = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.connection_parameters = {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.connection_recycle_time = 3600 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.connection_trace = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.db_inc_retry_interval = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.db_max_retries = 20 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.db_max_retry_interval = 10 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.db_retry_interval = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.max_overflow = 50 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.max_pool_size = 5 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.max_retries = 10 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.mysql_wsrep_sync_wait = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.pool_timeout = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.retry_interval = 10 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.slave_connection = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.sqlite_synchronous = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.synchronous_reader = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] database.use_db_reconnect = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack quobyte-client[86902]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 10:37:36 devstack quobyte-client[86902]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] CMD "mount.quobyte" returned: 1 in 0.157s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_tracing.insecure = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] profiler.connection_string = messaging:// {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] profiler.enabled = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] profiler.es_doc_type = notification {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] profiler.es_scroll_size = 10000 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] profiler.es_scroll_time = 2m {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] profiler.filter_error_trace = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] profiler.hmac_keys = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] profiler.sentinel_service_name = mymaster {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] profiler.socket_timeout = 0.1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] profiler.trace_requests = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] profiler.trace_sqlalchemy = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] profiler_jaeger.process_tags = {} {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] profiler_jaeger.service_name_prefix = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] profiler_otlp.service_name_prefix = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_policy.enforce_new_defaults = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_policy.policy_default_rule = default {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_policy.policy_file = policy.yaml {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] privsep_osbrick.group = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] privsep_osbrick.helper_command = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] privsep_osbrick.user = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cinder_sys_admin.group = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cinder_sys_admin.helper_command = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] cinder_sys_admin.user = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] service_user.auth_section = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] service_user.auth_type = password {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] service_user.cafile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] service_user.certfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] service_user.collect_timing = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] service_user.insecure = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] service_user.keyfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] service_user.send_service_user_token = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] service_user.split_loggers = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] service_user.timeout = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] service_user.tls_ciphers = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:37:36 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] service_user.tls_min_version = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance.auth_section = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance.auth_type = password {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance.certfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance.collect_timing = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance.insecure = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance.keyfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance.region_name = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance.split_loggers = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance.timeout = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance.tls_ciphers = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] glance.tls_min_version = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.backend_availability_zone = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.chap_password = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.chap_username = {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.disk_geometry = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.driver_client_cert = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.driver_client_cert_key = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.driver_data_namespace = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.driver_use_ssl = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.extra_capabilities = {} {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.filter_function = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.goodness_function = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.iscsi_target_flags = {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.iscsi_write_cache = on {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.iser_helper = tgtadm {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.iser_port = 3260 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.nas_host = {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.nas_login = admin {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.nas_mount_options = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.nas_password = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.nas_private_key = {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.nas_share_path = {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.num_shell_tries = 3 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.quobyte_volume_url = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.replication_device = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.report_discard_supported = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.reserved_percentage = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.target_helper = tgtadm {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.target_port = 3260 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.target_protocol = iscsi {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.trace_flags = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.unique_fqdn_network = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.use_chap_auth = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.volume_backend_name = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.volume_clear = zero {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.volume_clear_ionice = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.volume_clear_size = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_reports.file_event_handler = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_reports.log_dir = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.backend_availability_zone = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.backend_host = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.chap_password = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.chap_username = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.chiscsi_conf = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.disk_geometry = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.driver_client_cert = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.driver_data_namespace = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.driver_use_ssl = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.extra_capabilities = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.filter_function = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.goodness_function = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.iser_helper = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.iser_ip_address = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.iser_port = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.iser_target_prefix = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.nas_host = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.nas_login = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.nas_mount_options = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.nas_password = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.nas_private_key = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.nas_share_path = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.nas_ssh_port = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.num_shell_tries = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.nvmet_port_id = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.replication_device = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.report_discard_supported = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.reserved_percentage = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.scst_target_driver = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.storage_protocol = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.target_helper = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.target_ip_address = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.target_port = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.target_prefix = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.target_protocol = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.trace_flags = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.use_chap_auth = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.volume_clear = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.volume_clear_size = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] QuobyteHD.volumes_dir = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.ssl = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_notifications.driver = [] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_notifications.retry = -1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] key_manager.fixed_key = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.barbican_api_version = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.barbican_endpoint = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.barbican_endpoint_type = public {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.barbican_region_name = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.cafile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.certfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.collect_timing = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.insecure = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.keyfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.number_of_retries = 60 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.retry_delay = 1 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.send_service_user_token = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.split_loggers = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.timeout = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.tls_ciphers = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.tls_min_version = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.verify_ssl = True {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican.verify_ssl_path = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican_service_user.auth_section = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican_service_user.auth_type = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican_service_user.cafile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican_service_user.certfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican_service_user.collect_timing = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican_service_user.insecure = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican_service_user.keyfile = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican_service_user.split_loggers = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican_service_user.timeout = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican_service_user.tls_ciphers = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] barbican_service_user.tls_min_version = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.approle_role_id = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.approle_secret_id = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.auth_method = approle {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.auth_path = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.kv_mountpoint = secret {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.kv_path = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.kv_version = 2 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.namespace = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.root_token_id = **** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.ssl_ca_crt_file = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.timeout = 60.0 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.token_file = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.token_role = None {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.use_ssl = False {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:37:36 devstack cinder-volume[86581]: DEBUG oslo_service.backend._eventlet.service [None req-b8e00216-b07d-4307-8a39-e697d109d37d None None] ******************************************************************************** {{(pid=86581) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 10:37:36 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.511s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:36 devstack cinder-volume[86874]: INFO cinder.volume.driver [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Driver hasn't implemented _init_vendor_properties() Sep 25 10:37:36 devstack cinder-volume[86874]: DEBUG cinder.volume.driver [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4541511535645, 'free_capacity_gb': 1775.4541511535645, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86874) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 10:37:36 devstack cinder-volume[86874]: DEBUG oslo_db.sqlalchemy.engines [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86874) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writer thread running {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG cinder.db.api [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Building query based on filter {{(pid=86874) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86874) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:37 devstack cinder-volume[86874]: INFO cinder.keymgr.migration [None req-9b10ea0d-1967-4781-99d1-017850d535e9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 10:37:37 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:37:37 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:37 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.428s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:37 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Driver initialization completed successfully. Sep 25 10:37:37 devstack cinder-volume[86874]: INFO cinder.manager [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Initiating service 3 cleanup Sep 25 10:37:37 devstack cinder-volume[86874]: INFO cinder.manager [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Service 3 cleanup completed. Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG cinder.service [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Creating RPC server for service cinder-volume {{(pid=86874) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG cinder.service [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86874) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 10:37:37 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:37 devstack sudo[86929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:37:37 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:38 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.280s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:38 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-86ed6c38-1fc1-4dfa-829e-cb36a72a64db None None] Driver post RPC initialization completed successfully. Sep 25 10:37:45 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:37:47 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=3 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:37:48 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:38:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:38:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 6 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:38:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:38:56 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:38:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Flow 'volume_create_manager' (ff54f5b3-2680-4b8b-a370-1ea2a570f1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6d58e8-3067-4e55-b363-0843c7b44933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6d58e8-3067-4e55-b363-0843c7b44933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-934959180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7a9600-edee-4b99-9707-7fcc9dce9e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cdc38708d924d68bb6b464d656c2cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:56Z,use_quota=True,user_id='830a00c9d19344feb7c1d589573dc519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a454fa4-bca3-4bf1-9ec6-40b3da26da5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a454fa4-bca3-4bf1-9ec6-40b3da26da5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15418104-5f2f-4441-992e-c537c9cc59d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15418104-5f2f-4441-992e-c537c9cc59d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7a9600-edee-4b99-9707-7fcc9dce9e55', 'volume_name': 'volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7159481-a81f-47f0-8443-0c79af9a0480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7159481-a81f-47f0-8443-0c79af9a0480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c457d9de-32f7-4507-be33-656b2b121db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:56 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Volume 8a7a9600-edee-4b99-9707-7fcc9dce9e55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55', 'volume_size': 1} Sep 25 10:38:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-934959180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7a9600-edee-4b99-9707-7fcc9dce9e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cdc38708d924d68bb6b464d656c2cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:56Z,use_quota=True,user_id='830a00c9d19344feb7c1d589573dc519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:38:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Creating volume 8a7a9600-edee-4b99-9707-7fcc9dce9e55 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:38:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:38:57 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:38:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:57 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55 1073741824 Sep 25 10:38:57 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:59 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55 1073741824" returned: 0 in 2.089s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:59 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55 Sep 25 10:38:59 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:59 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55" returned: 0 in 0.653s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] <== create_volume: return (3004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:39:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c457d9de-32f7-4507-be33-656b2b121db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da86344c-8bd4-405d-84e0-131ccce5c07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:00 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Volume volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55 (8a7a9600-edee-4b99-9707-7fcc9dce9e55): created successfully Sep 25 10:39:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da86344c-8bd4-405d-84e0-131ccce5c07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Flow 'volume_create_manager' (ff54f5b3-2680-4b8b-a370-1ea2a570f1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:00 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-1732d02d-f312-45ce-bac4-65bc719eb97e tempest-DeleteServersTestJSON-578892074 None] Created volume successfully. Sep 25 10:39:07 devstack cinder-volume[86874]: WARNING py.warnings [req-12a00ae8-0069-48f6-90ea-0ee551694014 req-e7fc8b2d-e1e8-4421-adb8-05c5d05e07a6 tempest-DeleteServersTestJSON-578892074 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 25 10:39:07 devstack cinder-volume[86874]: .first() Sep 25 10:39:07 devstack cinder-volume[86874]: Sep 25 10:39:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-12a00ae8-0069-48f6-90ea-0ee551694014 req-e7fc8b2d-e1e8-4421-adb8-05c5d05e07a6 tempest-DeleteServersTestJSON-578892074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-12a00ae8-0069-48f6-90ea-0ee551694014 req-e7fc8b2d-e1e8-4421-adb8-05c5d05e07a6 tempest-DeleteServersTestJSON-578892074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-12a00ae8-0069-48f6-90ea-0ee551694014 req-e7fc8b2d-e1e8-4421-adb8-05c5d05e07a6 tempest-DeleteServersTestJSON-578892074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-12a00ae8-0069-48f6-90ea-0ee551694014 req-e7fc8b2d-e1e8-4421-adb8-05c5d05e07a6 tempest-DeleteServersTestJSON-578892074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '599b1422-bade-4989-920e-e0d24f75a556', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:39:08 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-12a00ae8-0069-48f6-90ea-0ee551694014 req-e7fc8b2d-e1e8-4421-adb8-05c5d05e07a6 tempest-DeleteServersTestJSON-578892074 None] attachment_update completed successfully. Sep 25 10:39:17 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-ba6a3e7f-783c-465f-92d1-3de67e6f9c5b req-5988d369-c274-469e-bf95-da332f18e4f0 tempest-DeleteServersTestJSON-578892074 None] Terminate volume connection completed successfully. Sep 25 10:39:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-ba6a3e7f-783c-465f-92d1-3de67e6f9c5b req-5988d369-c274-469e-bf95-da332f18e4f0 tempest-DeleteServersTestJSON-578892074 None] Deleting attachment 599b1422-bade-4989-920e-e0d24f75a556. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:39:18 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:39:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Acquiring lock "cinder-8a7a9600-edee-4b99-9707-7fcc9dce9e55-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Lock "cinder-8a7a9600-edee-4b99-9707-7fcc9dce9e55-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Acquiring lock "cinder-quobyte-8a7a9600-edee-4b99-9707-7fcc9dce9e55" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Lock "cinder-quobyte-8a7a9600-edee-4b99-9707-7fcc9dce9e55" acquired by "delete_volume" :: waited 0.018s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:20 devstack cinder-volume[86874]: INFO oslo.privsep.daemon [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxd24n6sl/privsep.sock'] Sep 25 10:39:20 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxd24n6sl/privsep.sock Sep 25 10:39:20 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:22 devstack cinder-volume[86874]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 25 10:39:22 devstack cinder-volume[86874]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 10:39:22 devstack cinder-volume[86874]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 25 10:39:22 devstack cinder-volume[86874]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 10:39:22 devstack cinder-volume[86874]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 25 10:39:22 devstack cinder-volume[86874]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 25 10:39:22 devstack cinder-volume[86874]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 10:39:22 devstack cinder-volume[86874]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 10:39:22 devstack cinder-volume[86874]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 25 10:39:22 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:22 devstack cinder-volume[86874]: INFO oslo.privsep.daemon [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Spawned new privsep daemon via rootwrap Sep 25 10:39:22 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Accepted privsep connection to /tmp/tmpxd24n6sl/privsep.sock {{(pid=86874) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 25 10:39:22 devstack cinder-volume[86874]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 10:39:22 devstack cinder-volume[86874]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 10:39:22 devstack cinder-volume[86874]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 10:39:22 devstack cinder-volume[86874]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88786 Sep 25 10:39:22 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ac5e0e-14d1-4942-93cb-f2f45bca6e1d]: (2,) {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:22 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6e8802-ab8e-4955-8eda-3155d957aadc]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:22 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55 Sep 25 10:39:22 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:23 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55" returned: 0 in 0.561s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:23 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55 Sep 25 10:39:23 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:23 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a7a9600-edee-4b99-9707-7fcc9dce9e55" returned: 0 in 0.507s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Lock "cinder-quobyte-8a7a9600-edee-4b99-9707-7fcc9dce9e55" released by "delete_volume" :: held 3.418s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:23 devstack cinder-volume[86874]: WARNING cinder.quota [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:39:23 devstack cinder-volume[86874]: WARNING cinder.quota [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:39:23 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Created reservations ['54e632ae-b04d-463a-8b51-82fd01a66914', '93d2f7fe-db0b-4204-97dd-8415792daf3b', '9ad9b549-a6f9-443d-a535-7a5825507fe9', '1c9bce59-fbf2-4290-b493-2ab3efec2d29'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:24 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:39:24 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Flow 'volume_create_manager' (1e527901-0e20-4235-9b23-6487bc8e5963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c213345c-565f-42b6-9576-f07f48a7c656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c213345c-565f-42b6-9576-f07f48a7c656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1754688829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8038b81c8c244590a0df41dddba545e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:24Z,use_quota=True,user_id='8c4fe4ebbeeb42108b2efd4cd0f27fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf2c23b-9d80-493b-b474-b42b637b2a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf2c23b-9d80-493b-b474-b42b637b2a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c22bd64-0cb1-42c7-8de8-2b5567e2070a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c22bd64-0cb1-42c7-8de8-2b5567e2070a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592', 'volume_name': 'volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45dad65-c0fa-459d-8e21-6fded14efda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45dad65-c0fa-459d-8e21-6fded14efda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e68393c-5d0b-4784-ae93-34d73bb3f142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:24 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Volume bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592', 'volume_size': 1} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1754688829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8038b81c8c244590a0df41dddba545e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:24Z,use_quota=True,user_id='8c4fe4ebbeeb42108b2efd4cd0f27fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Creating volume bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:39:24 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:24 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592 1073741824 Sep 25 10:39:24 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:24 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.458s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:39:24 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Deleted volume successfully. Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-947e9372-1df4-4bc8-b71c-655c048b8107 tempest-DeleteServersTestJSON-578892074 None] Lock "cinder-8a7a9600-edee-4b99-9707-7fcc9dce9e55-delete_volume" released by "delete_volume" :: held 4.409s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Flow 'volume_create_manager' (da520c7f-3d1c-413d-a6d8-cb6c957d55e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0fc9ea-ca21-4787-80fb-4765abdc90f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0fc9ea-ca21-4787-80fb-4765abdc90f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1035774040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437de506-8d18-4173-b8df-03b27be4c16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983cb13288da47c88af2b91ff12abc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:25Z,use_quota=True,user_id='1fe5ff6d1c9944fcbe913a2179a9b881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f766d5a-f0ec-4d13-a838-ae6d199bd9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f766d5a-f0ec-4d13-a838-ae6d199bd9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41a2380-0fef-4f48-ac76-31cca4c31f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41a2380-0fef-4f48-ac76-31cca4c31f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437de506-8d18-4173-b8df-03b27be4c16a', 'volume_name': 'volume-437de506-8d18-4173-b8df-03b27be4c16a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85feac2e-f916-41e8-aaa1-30362387405d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85feac2e-f916-41e8-aaa1-30362387405d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a4e4b7-1739-43eb-bbde-927afe7088cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:25 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Volume 437de506-8d18-4173-b8df-03b27be4c16a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437de506-8d18-4173-b8df-03b27be4c16a', 'volume_size': 1} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:25 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592 1073741824" returned: 0 in 0.728s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:25 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592 Sep 25 10:39:25 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:25 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592" returned: 0 in 0.363s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1035774040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437de506-8d18-4173-b8df-03b27be4c16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983cb13288da47c88af2b91ff12abc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:25Z,use_quota=True,user_id='1fe5ff6d1c9944fcbe913a2179a9b881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Creating volume 437de506-8d18-4173-b8df-03b27be4c16a {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:39:25 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-437de506-8d18-4173-b8df-03b27be4c16a 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e68393c-5d0b-4784-ae93-34d73bb3f142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0dbb0f-fd5a-4ff4-ac2a-f72b70957f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:25 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-437de506-8d18-4173-b8df-03b27be4c16a 1073741824 Sep 25 10:39:25 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:25 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Volume volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592 (bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592): created successfully Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0dbb0f-fd5a-4ff4-ac2a-f72b70957f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Flow 'volume_create_manager' (1e527901-0e20-4235-9b23-6487bc8e5963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:25 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-19a46eb9-05d8-4052-b651-a057ae940e0f tempest-ServersNegativeTestJSON-474786670 None] Created volume successfully. Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:26 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:39:26 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:26 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-437de506-8d18-4173-b8df-03b27be4c16a 1073741824" returned: 0 in 0.703s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-437de506-8d18-4173-b8df-03b27be4c16a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:26 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-437de506-8d18-4173-b8df-03b27be4c16a Sep 25 10:39:26 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:26 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.408s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 8 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:39:26 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-437de506-8d18-4173-b8df-03b27be4c16a" returned: 0 in 0.356s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a4e4b7-1739-43eb-bbde-927afe7088cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437de506-8d18-4173-b8df-03b27be4c16a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580ae89b-7cfe-464c-9e82-62d0d80ff7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:26 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Volume volume-437de506-8d18-4173-b8df-03b27be4c16a (437de506-8d18-4173-b8df-03b27be4c16a): created successfully Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580ae89b-7cfe-464c-9e82-62d0d80ff7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Flow 'volume_create_manager' (da520c7f-3d1c-413d-a6d8-cb6c957d55e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:26 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8bc2329d-92c4-4056-9366-e30061b44217 tempest-ServerActionsTestOtherA-1991731764 None] Created volume successfully. Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Flow 'volume_create_manager' (6fc68879-44fd-4075-9cbe-4fe6a01603ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9205dc-468e-41e9-aa23-7bc7c1fe7610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9205dc-468e-41e9-aa23-7bc7c1fe7610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1846935887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8038b81c8c244590a0df41dddba545e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:32Z,use_quota=True,user_id='8c4fe4ebbeeb42108b2efd4cd0f27fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ef89a5-52f1-484c-b244-6f6a96a298b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ef89a5-52f1-484c-b244-6f6a96a298b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a495525e-3f21-491d-ae7b-81563e7c2ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a495525e-3f21-491d-ae7b-81563e7c2ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0', 'volume_name': 'volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3529782e-0b9e-4ad8-962c-5d4c066dbde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3529782e-0b9e-4ad8-962c-5d4c066dbde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73d5c7a-da06-4fc2-91a5-d8ac1b5e4b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:32 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Volume 588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0', 'volume_size': 1} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1846935887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8038b81c8c244590a0df41dddba545e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:32Z,use_quota=True,user_id='8c4fe4ebbeeb42108b2efd4cd0f27fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Creating volume 588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:39:32 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:39:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:32 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0 1073741824 Sep 25 10:39:32 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:33 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0 1073741824" returned: 0 in 0.805s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:33 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0 Sep 25 10:39:33 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:34 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0" returned: 0 in 0.666s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:39:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73d5c7a-da06-4fc2-91a5-d8ac1b5e4b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1f28fd-4f29-4252-9838-69c37671f5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:34 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Volume volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0 (588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0): created successfully Sep 25 10:39:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1f28fd-4f29-4252-9838-69c37671f5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Flow 'volume_create_manager' (6fc68879-44fd-4075-9cbe-4fe6a01603ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:34 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4c0cb30b-71d6-4b34-a4c8-b4c935caedf0 tempest-ServersNegativeTestJSON-474786670 None] Created volume successfully. Sep 25 10:39:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Acquiring lock "cinder-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Lock "cinder-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Acquiring lock "cinder-quobyte-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Lock "cinder-quobyte-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0" acquired by "delete_volume" :: waited 0.036s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:35 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bfb013-7492-48bf-bae8-2e9c02dab523]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:36 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0 Sep 25 10:39:36 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:36 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0" returned: 0 in 0.706s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:36 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0 Sep 25 10:39:36 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0" returned: 0 in 0.463s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:37 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Lock "cinder-quobyte-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0" released by "delete_volume" :: held 1.254s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:37 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Created reservations ['2dda1a51-a069-40d9-aafd-e714eacc58af', '3c62b0b9-597f-4277-b438-fc2016691f31', 'ba93f6f1-3dc8-4e8d-a7f0-b58f70df71bc', 'c18d7b09-ee99-4229-abb8-2e6fbf7a7a08'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:37 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:39:37 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:37 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.318s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:37 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:39:37 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Deleted volume successfully. Sep 25 10:39:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c71af317-ffe3-4327-ad0f-b895601cafbc tempest-ServersNegativeTestJSON-474786670 None] Lock "cinder-588bcb9c-d4f2-4b21-b637-ea7d59ebfdb0-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Acquiring lock "cinder-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Lock "cinder-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Acquiring lock "cinder-quobyte-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Lock "cinder-quobyte-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:38 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ac09b8-5be6-4fce-b5a9-5feeb442deab]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:38 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592 Sep 25 10:39:38 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:38 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592" returned: 0 in 0.622s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:38 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592 Sep 25 10:39:38 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:39 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592" returned: 0 in 0.512s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Lock "cinder-quobyte-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592" released by "delete_volume" :: held 1.210s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:39 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Created reservations ['0b3546cd-9818-4db6-a358-48d257442866', 'fe0532eb-ab8a-417e-95be-eaa9f232d1ed', 'afdc2d58-5913-4786-a559-fa7028cc0e4d', '6869bdc7-8579-41c8-9c8e-7dd9a56f7b0b'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:39 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:39:39 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:39 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.371s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:40 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:39:40 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Deleted volume successfully. Sep 25 10:39:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d22c3af0-8c08-47da-b5b2-f3ab84bc2524 tempest-ServersNegativeTestJSON-474786670 None] Lock "cinder-bdb3ab38-d9b0-49eb-b5b1-7ecdbbd40592-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:49 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=31,cinder:SELECT=19,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:39:50 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=34,cinder:INSERT=10,cinder:UPDATE=40,cinder:DELETE=3 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:40:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-0cf6a9a8-a581-48cc-a1a9-b494fbdcac87 req-85f99878-7933-4687-81a2-ebed665c12aa tempest-ServerActionsTestOtherA-1991731764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-0cf6a9a8-a581-48cc-a1a9-b494fbdcac87 req-85f99878-7933-4687-81a2-ebed665c12aa tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-0cf6a9a8-a581-48cc-a1a9-b494fbdcac87 req-85f99878-7933-4687-81a2-ebed665c12aa tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-0cf6a9a8-a581-48cc-a1a9-b494fbdcac87 req-85f99878-7933-4687-81a2-ebed665c12aa tempest-ServerActionsTestOtherA-1991731764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-437de506-8d18-4173-b8df-03b27be4c16a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd760d6d8-de4d-4987-b511-b2683a82b6ef', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:40:17 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-0cf6a9a8-a581-48cc-a1a9-b494fbdcac87 req-85f99878-7933-4687-81a2-ebed665c12aa tempest-ServerActionsTestOtherA-1991731764 None] attachment_update completed successfully. Sep 25 10:40:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:40:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:26 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:40:26 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.475s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:40:26 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:27 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:40:27 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:40:28 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-e272da1f-a5a6-46c0-98b2-6ad8d61af663 req-9b7f66cb-c84c-47b7-a935-fa89fb474671 tempest-ServerActionsTestOtherA-1991731764 None] Terminate volume connection completed successfully. Sep 25 10:40:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e272da1f-a5a6-46c0-98b2-6ad8d61af663 req-9b7f66cb-c84c-47b7-a935-fa89fb474671 tempest-ServerActionsTestOtherA-1991731764 None] Deleting attachment d760d6d8-de4d-4987-b511-b2683a82b6ef. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:40:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-e272da1f-a5a6-46c0-98b2-6ad8d61af663 req-27719658-548f-4853-a822-ee5d0efb4391 tempest-ServerActionsTestOtherA-1991731764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-e272da1f-a5a6-46c0-98b2-6ad8d61af663 req-27719658-548f-4853-a822-ee5d0efb4391 tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-e272da1f-a5a6-46c0-98b2-6ad8d61af663 req-27719658-548f-4853-a822-ee5d0efb4391 tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e272da1f-a5a6-46c0-98b2-6ad8d61af663 req-27719658-548f-4853-a822-ee5d0efb4391 tempest-ServerActionsTestOtherA-1991731764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-437de506-8d18-4173-b8df-03b27be4c16a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95585f67-318b-4d91-9962-6c27045dc12c', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:40:31 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-e272da1f-a5a6-46c0-98b2-6ad8d61af663 req-27719658-548f-4853-a822-ee5d0efb4391 tempest-ServerActionsTestOtherA-1991731764 None] attachment_update completed successfully. Sep 25 10:40:41 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:40:41 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:41:00 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Flow 'volume_create_manager' (5be9f31b-cb40-4cd5-ab1e-fdb0c014e2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d27d24-fa31-4f14-82e4-6b845c3db1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d27d24-fa31-4f14-82e4-6b845c3db1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1138136008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf96065-8cb1-4b8f-b9a8-343e2d3ece18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8db0d3bc69d432b94c0baabf35194d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:01Z,use_quota=True,user_id='db68701ee07340d9bebde2564441aaa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9194d4d7-2f00-4b7c-b34d-1fa4c30f4434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9194d4d7-2f00-4b7c-b34d-1fa4c30f4434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c80c39-5978-4c15-9fbe-7fb7b51ab636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c80c39-5978-4c15-9fbe-7fb7b51ab636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bf96065-8cb1-4b8f-b9a8-343e2d3ece18', 'volume_name': 'volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4891c7-442f-4a50-9c33-6cd362ebb28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4891c7-442f-4a50-9c33-6cd362ebb28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4657acdf-e4d6-41bf-982e-2fb318a6443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:01 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Volume 7bf96065-8cb1-4b8f-b9a8-343e2d3ece18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18', 'volume_size': 1} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1138136008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf96065-8cb1-4b8f-b9a8-343e2d3ece18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8db0d3bc69d432b94c0baabf35194d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:01Z,use_quota=True,user_id='db68701ee07340d9bebde2564441aaa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Creating volume 7bf96065-8cb1-4b8f-b9a8-343e2d3ece18 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:41:01 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:41:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:01 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18 1073741824 Sep 25 10:41:01 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:02 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18 1073741824" returned: 0 in 1.284s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:02 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18 Sep 25 10:41:02 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:03 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18" returned: 0 in 0.563s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:41:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4657acdf-e4d6-41bf-982e-2fb318a6443d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3e9721-2f1c-461a-b2ce-1523b4bd58bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:03 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Volume volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18 (7bf96065-8cb1-4b8f-b9a8-343e2d3ece18): created successfully Sep 25 10:41:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3e9721-2f1c-461a-b2ce-1523b4bd58bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Flow 'volume_create_manager' (5be9f31b-cb40-4cd5-ab1e-fdb0c014e2b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:03 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-3c153607-cfaf-42ca-9e35-e5b93d6da38a tempest-ServerRescueNegativeTestJSON-1007235915 None] Created volume successfully. Sep 25 10:41:13 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:41:13 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Flow 'volume_create_manager' (16a87c70-4bdf-452c-8548-d31d5fb2ba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb132718-2dab-4a09-99fa-ce2560c03472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb132718-2dab-4a09-99fa-ce2560c03472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1684942154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0661f3-8ebe-4559-bd52-17626ae1dc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de8018435014d0db194a3cf152c152c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:18Z,use_quota=True,user_id='50c5dae9b96c4b279b6080903a9f41c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7135ad3d-1b4f-4b94-912a-6338e25b36c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7135ad3d-1b4f-4b94-912a-6338e25b36c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6411562c-4acb-4a66-8a21-ca9707793419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6411562c-4acb-4a66-8a21-ca9707793419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0661f3-8ebe-4559-bd52-17626ae1dc2c', 'volume_name': 'volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08926335-10d7-4f77-bb94-2e7a304c46d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08926335-10d7-4f77-bb94-2e7a304c46d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5227ee1a-84dd-4dae-ac28-01111456dc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:18 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Volume 2f0661f3-8ebe-4559-bd52-17626ae1dc2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c', 'volume_size': 1} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1684942154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0661f3-8ebe-4559-bd52-17626ae1dc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de8018435014d0db194a3cf152c152c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:18Z,use_quota=True,user_id='50c5dae9b96c4b279b6080903a9f41c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Creating volume 2f0661f3-8ebe-4559-bd52-17626ae1dc2c {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:41:18 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:41:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:18 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c 1073741824 Sep 25 10:41:18 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:19 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c 1073741824" returned: 0 in 0.852s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:19 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c Sep 25 10:41:19 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:19 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c" returned: 0 in 0.600s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:41:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5227ee1a-84dd-4dae-ac28-01111456dc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad508a9-c425-44c9-a60f-1e908263a974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:19 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Volume volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c (2f0661f3-8ebe-4559-bd52-17626ae1dc2c): created successfully Sep 25 10:41:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad508a9-c425-44c9-a60f-1e908263a974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Flow 'volume_create_manager' (16a87c70-4bdf-452c-8548-d31d5fb2ba38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:19 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b11af035-e667-4612-a3a4-8ff35fb24ad6 tempest-VolumesAdminNegativeTest-1811922944 None] Created volume successfully. Sep 25 10:41:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Acquiring lock "cinder-2f0661f3-8ebe-4559-bd52-17626ae1dc2c-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Lock "cinder-2f0661f3-8ebe-4559-bd52-17626ae1dc2c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Acquiring lock "cinder-quobyte-2f0661f3-8ebe-4559-bd52-17626ae1dc2c" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Lock "cinder-quobyte-2f0661f3-8ebe-4559-bd52-17626ae1dc2c" acquired by "delete_volume" :: waited 0.065s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:21 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c4fc1a-19a3-4a40-85f1-9c3de86da2ea]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:21 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c Sep 25 10:41:21 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:21 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-35db62f4-8975-4057-ba71-9338fe6c494a req-71427ae4-2ccd-4753-8cf8-d18aad909da5 tempest-ServerActionsTestOtherA-1991731764 None] Terminate volume connection completed successfully. Sep 25 10:41:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-35db62f4-8975-4057-ba71-9338fe6c494a req-71427ae4-2ccd-4753-8cf8-d18aad909da5 tempest-ServerActionsTestOtherA-1991731764 None] Deleting attachment 95585f67-318b-4d91-9962-6c27045dc12c. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:41:21 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c" returned: 0 in 0.621s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:21 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c Sep 25 10:41:21 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:22 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f0661f3-8ebe-4559-bd52-17626ae1dc2c" returned: 0 in 0.573s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Lock "cinder-quobyte-2f0661f3-8ebe-4559-bd52-17626ae1dc2c" released by "delete_volume" :: held 1.329s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:22 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Created reservations ['c00b69cb-d975-446c-a2d0-7fa987529bc0', '976c7272-f90c-4db5-aa99-f483f33fb5eb', '5f8922d3-7dce-4e46-a184-ae567e0d2dbd', '1ec159d1-c951-4200-ad18-731875b1c790'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:41:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:22 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:41:22 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Acquiring lock "cinder-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Lock "cinder-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Acquiring lock "cinder-quobyte-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Lock "cinder-quobyte-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18" acquired by "delete_volume" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:23 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[765f9e39-6bc9-45bd-bbcc-a384fe3a741f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:23 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.646s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:23 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:41:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Deleted volume successfully. Sep 25 10:41:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e75f93c3-a7ba-43a9-8cad-e64bbe3d208e tempest-VolumesAdminNegativeTest-1811922944 None] Lock "cinder-2f0661f3-8ebe-4559-bd52-17626ae1dc2c-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:23 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18 Sep 25 10:41:23 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:24 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18" returned: 0 in 1.388s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:24 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18 Sep 25 10:41:24 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:25 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18" returned: 0 in 0.779s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Lock "cinder-quobyte-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18" released by "delete_volume" :: held 2.299s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:25 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Created reservations ['88bf6e4f-53ef-42d3-8689-9ed16331ba07', '2019c938-cdd2-4cc6-b251-18b8e436a001', 'faf84132-3f51-4f7c-98c5-cabb6b2cdcbb', '614fd6b8-d943-4f7c-a140-6cce4b60d4b0'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:41:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:25 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:41:25 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:26 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:41:26 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:26 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.631s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:41:26 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Deleted volume successfully. Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f88e4a7a-e013-4f7a-b1b1-e55b8e55270e tempest-ServerRescueNegativeTestJSON-1007235915 None] Lock "cinder-7bf96065-8cb1-4b8f-b9a8-343e2d3ece18-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:26 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.507s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 8 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:41:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Flow 'volume_create_manager' (53ec2d75-e367-428a-be9a-d301afcea210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef173f4b-fb3a-49bb-ad0a-62498f05efe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef173f4b-fb3a-49bb-ad0a-62498f05efe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1387033652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e220af-7986-41e2-a85b-700db580b6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e340ba3124e453ab874fdc4b0d304d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:34Z,use_quota=True,user_id='2e142be97677485bb29e3d512c973cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ac3c85-55d3-422a-9dc2-d8dd506bc8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ac3c85-55d3-422a-9dc2-d8dd506bc8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b255af-15ac-4f0f-8c3c-e1bfc0861148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b255af-15ac-4f0f-8c3c-e1bfc0861148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4e220af-7986-41e2-a85b-700db580b6d0', 'volume_name': 'volume-e4e220af-7986-41e2-a85b-700db580b6d0', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9993c20-15c9-4444-86f8-92655fe4a835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9993c20-15c9-4444-86f8-92655fe4a835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73541bd8-415b-47d8-bc41-592310f298f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:34 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Volume e4e220af-7986-41e2-a85b-700db580b6d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4e220af-7986-41e2-a85b-700db580b6d0', 'volume_size': 1} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1387033652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e220af-7986-41e2-a85b-700db580b6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e340ba3124e453ab874fdc4b0d304d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:34Z,use_quota=True,user_id='2e142be97677485bb29e3d512c973cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Creating volume e4e220af-7986-41e2-a85b-700db580b6d0 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:41:34 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:41:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e4e220af-7986-41e2-a85b-700db580b6d0 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:34 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e4e220af-7986-41e2-a85b-700db580b6d0 1073741824 Sep 25 10:41:34 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:35 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e4e220af-7986-41e2-a85b-700db580b6d0 1073741824" returned: 0 in 0.876s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e4e220af-7986-41e2-a85b-700db580b6d0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:35 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e4e220af-7986-41e2-a85b-700db580b6d0 Sep 25 10:41:35 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:36 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e4e220af-7986-41e2-a85b-700db580b6d0" returned: 0 in 0.597s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73541bd8-415b-47d8-bc41-592310f298f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e220af-7986-41e2-a85b-700db580b6d0', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16126139-e78e-48bd-b1ce-b6c29fd2ba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:36 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Volume volume-e4e220af-7986-41e2-a85b-700db580b6d0 (e4e220af-7986-41e2-a85b-700db580b6d0): created successfully Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16126139-e78e-48bd-b1ce-b6c29fd2ba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Flow 'volume_create_manager' (53ec2d75-e367-428a-be9a-d301afcea210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:36 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-25f41920-d192-4ba9-a29e-9d0471b3bcd0 tempest-AttachVolumeShelveTestJSON-245439624 None] Created volume successfully. Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Flow 'volume_create_manager' (f8194e47-436c-4aee-a7ae-755398ec772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45f9242-f2e0-429d-8510-d9391c565835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45f9242-f2e0-429d-8510-d9391c565835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-372363014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b14a6e-38ab-43d0-b982-c9e324cafb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983cb13288da47c88af2b91ff12abc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:36Z,use_quota=True,user_id='1fe5ff6d1c9944fcbe913a2179a9b881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a40ad54-124e-4a75-8463-bb12f8d5f4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a40ad54-124e-4a75-8463-bb12f8d5f4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178bce47-897f-40ed-9f83-5f261ab2358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:36 devstack cinder-volume[86874]: DEBUG cinder.image.glance [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Creating Keystone auth plugin from conf {{(pid=86874) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:41:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178bce47-897f-40ed-9f83-5f261ab2358c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59b14a6e-38ab-43d0-b982-c9e324cafb67', 'volume_name': 'volume-59b14a6e-38ab-43d0-b982-c9e324cafb67', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7891b2a-8569-4684-9359-00345ee93a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7891b2a-8569-4684-9359-00345ee93a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fa44a8-53c4-4b50-9021-2ed46045cda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:37 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Volume 59b14a6e-38ab-43d0-b982-c9e324cafb67: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59b14a6e-38ab-43d0-b982-c9e324cafb67', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 10:41:37 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Trying to clone 59b14a6e-38ab-43d0-b982-c9e324cafb67 from image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]). {{(pid=86874) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:41:37 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_xvvrztk9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:41:37 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Image download 20.69 MB at 20.69 MB/s Sep 25 10:41:37 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeff2fa-e220-470e-aff3-3640f1c2691f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_xvvrztk9devstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:38 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_xvvrztk9devstack@QuobyteHD Sep 25 10:41:38 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:38 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_xvvrztk9devstack@QuobyteHD" returned: 0 in 0.483s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:38 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Temporary image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 is fetched for user 1fe5ff6d1c9944fcbe913a2179a9b881. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:41:38 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e75a88c-2cba-40ca-8a99-afa36d7c23b1]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_xvvrztk9devstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:38 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_xvvrztk9devstack@QuobyteHD Sep 25 10:41:38 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:39 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_xvvrztk9devstack@QuobyteHD" returned: 0 in 0.674s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-372363014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b14a6e-38ab-43d0-b982-c9e324cafb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983cb13288da47c88af2b91ff12abc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:36Z,use_quota=True,user_id='1fe5ff6d1c9944fcbe913a2179a9b881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:41:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Creating volume 59b14a6e-38ab-43d0-b982-c9e324cafb67 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:41:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:41:39 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:41:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:39 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 1073741824 Sep 25 10:41:39 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:40 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 1073741824" returned: 0 in 0.847s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:40 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 Sep 25 10:41:40 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:40 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67" returned: 0 in 0.355s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:41:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:40 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Attempting download of 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}])) to volume 59b14a6e-38ab-43d0-b982-c9e324cafb67. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 10:41:40 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79d4491-4e54-45e8-8def-68ceac61ac6f]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_vx9vqfdp {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:40 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_vx9vqfdp Sep 25 10:41:40 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:41 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_vx9vqfdp" returned: 0 in 0.504s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_vx9vqfdp {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:41 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_vx9vqfdp Sep 25 10:41:41 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:41 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_vx9vqfdp" returned: 1 in 0.438s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_vx9vqfdp' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:41:41 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4011c920-57ba-4171-a935-1244ddcafd35]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_xvvrztk9devstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:41 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_xvvrztk9devstack@QuobyteHD Sep 25 10:41:41 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:42 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_xvvrztk9devstack@QuobyteHD" returned: 0 in 0.640s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:42 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 was qcow2, converting to qcow2 {{(pid=86874) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:41:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_xvvrztk9devstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:42 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_xvvrztk9devstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 Sep 25 10:41:42 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:45 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_xvvrztk9devstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67" returned: 0 in 2.872s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:45 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_xvvrztk9devstack@QuobyteHD, size 112.00 MB, duration 2.87 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:41:45 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Converted 112.00 MB image at 38.97 MB/s Sep 25 10:41:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:45 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 1G Sep 25 10:41:45 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:45 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 1G" returned: 0 in 0.519s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:45 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Downloaded image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}])) to volume 59b14a6e-38ab-43d0-b982-c9e324cafb67 successfully. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 10:41:45 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Temporary image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 for user 1fe5ff6d1c9944fcbe913a2179a9b881 is deleted. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:41:45 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Marking volume 59b14a6e-38ab-43d0-b982-c9e324cafb67 as bootable. {{(pid=86874) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 10:41:45 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Copying metadata from image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 to 59b14a6e-38ab-43d0-b982-c9e324cafb67. {{(pid=86874) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:41:45 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Creating volume glance metadata for volume 59b14a6e-38ab-43d0-b982-c9e324cafb67 backed by image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86874) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:41:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fa44a8-53c4-4b50-9021-2ed46045cda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b14a6e-38ab-43d0-b982-c9e324cafb67', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8545252-e7fc-4867-b3d3-7ccd857937ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:45 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Volume volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 (59b14a6e-38ab-43d0-b982-c9e324cafb67): created successfully Sep 25 10:41:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8545252-e7fc-4867-b3d3-7ccd857937ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Flow 'volume_create_manager' (f8194e47-436c-4aee-a7ae-755398ec772b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:45 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-22bf910e-eccf-47a4-9430-2dc838de143b tempest-ServerActionsTestOtherA-1991731764 None] Created volume successfully. Sep 25 10:41:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a59ea5c4-acad-44db-a915-9d64c19af54a req-b76c88db-68b3-475e-9c6f-64e32118837c tempest-ServerActionsTestOtherA-1991731764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a59ea5c4-acad-44db-a915-9d64c19af54a req-b76c88db-68b3-475e-9c6f-64e32118837c tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a59ea5c4-acad-44db-a915-9d64c19af54a req-b76c88db-68b3-475e-9c6f-64e32118837c tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-a59ea5c4-acad-44db-a915-9d64c19af54a req-b76c88db-68b3-475e-9c6f-64e32118837c tempest-ServerActionsTestOtherA-1991731764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-59b14a6e-38ab-43d0-b982-c9e324cafb67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc394f6e-204d-4a16-9249-e62521f85a7e', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:41:52 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-a59ea5c4-acad-44db-a915-9d64c19af54a req-b76c88db-68b3-475e-9c6f-64e32118837c tempest-ServerActionsTestOtherA-1991731764 None] attachment_update completed successfully. Sep 25 10:41:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-6116c6f3-9acc-46a0-a276-bfd0a26c943e req-550b6c50-01bd-4804-a1e1-342fdc46ce8f tempest-AttachVolumeShelveTestJSON-245439624 None] No connector for attachment d0774328-ccd8-437b-891e-4d3469011938; skipping storage backend terminate_connection call. {{(pid=86874) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 25 10:41:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-6116c6f3-9acc-46a0-a276-bfd0a26c943e req-550b6c50-01bd-4804-a1e1-342fdc46ce8f tempest-AttachVolumeShelveTestJSON-245439624 None] Deleting attachment d0774328-ccd8-437b-891e-4d3469011938. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:42:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3772e45e-64a3-410c-9ab7-c65ccbad5af2 tempest-BackendsCapabilitiesAdminTestsJSON-1363767811 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4541511535645, 'free_capacity_gb': 1775.4541511535645, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86874) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 10:42:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-135f2904-017b-4533-9045-0f02931429a1 tempest-BackendsCapabilitiesAdminTestsJSON-1363767811 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4541511535645, 'free_capacity_gb': 1775.4541511535645, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86874) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 10:42:04 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=27,cinder:SELECT=34,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:42:04 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=31,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=13 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Flow 'volume_create_manager' (a9c42942-42a8-4063-8be7-59abdd5b2dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507a48c8-6f34-4efe-907f-adef91a99c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507a48c8-6f34-4efe-907f-adef91a99c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1532015830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b93ea09-6155-4067-baec-e085bbbc7471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52983defae1c4e1eb2e9ab051ed15596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:22Z,use_quota=True,user_id='41d89dc5c0a94cbeb7a28981bd9ae12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c621a2c-00d1-4ede-b384-15273662a128),volume_type_id=7c621a2c-00d1-4ede-b384-15273662a128)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cab04c-1390-4c94-8a94-d74045f2e148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cab04c-1390-4c94-8a94-d74045f2e148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f5846e-1581-493d-b35b-6498de1a0d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f5846e-1581-493d-b35b-6498de1a0d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b93ea09-6155-4067-baec-e085bbbc7471', 'volume_name': 'volume-7b93ea09-6155-4067-baec-e085bbbc7471', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca261f3-8926-4972-8fbd-067c055de3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca261f3-8926-4972-8fbd-067c055de3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2ea741-d7d6-42d0-bea6-887252b4022c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:21 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Volume 7b93ea09-6155-4067-baec-e085bbbc7471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b93ea09-6155-4067-baec-e085bbbc7471', 'volume_size': 1} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1532015830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b93ea09-6155-4067-baec-e085bbbc7471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52983defae1c4e1eb2e9ab051ed15596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:22Z,use_quota=True,user_id='41d89dc5c0a94cbeb7a28981bd9ae12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c621a2c-00d1-4ede-b384-15273662a128),volume_type_id=7c621a2c-00d1-4ede-b384-15273662a128)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Creating volume 7b93ea09-6155-4067-baec-e085bbbc7471 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:21 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:42:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b93ea09-6155-4067-baec-e085bbbc7471 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:21 devstack sudo[91874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b93ea09-6155-4067-baec-e085bbbc7471 1073741824 Sep 25 10:42:21 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:22 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b93ea09-6155-4067-baec-e085bbbc7471 1073741824" returned: 0 in 0.946s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b93ea09-6155-4067-baec-e085bbbc7471 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:22 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b93ea09-6155-4067-baec-e085bbbc7471 Sep 25 10:42:22 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b93ea09-6155-4067-baec-e085bbbc7471" returned: 0 in 0.514s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:23 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:42:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2ea741-d7d6-42d0-bea6-887252b4022c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b93ea09-6155-4067-baec-e085bbbc7471', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259805c4-4ccf-4e3e-95df-625d95b55974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:23 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Volume volume-7b93ea09-6155-4067-baec-e085bbbc7471 (7b93ea09-6155-4067-baec-e085bbbc7471): created successfully Sep 25 10:42:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259805c4-4ccf-4e3e-95df-625d95b55974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Flow 'volume_create_manager' (a9c42942-42a8-4063-8be7-59abdd5b2dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2e9df0d8-e305-4ef8-83b8-14c4227e83dd tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Created volume successfully. Sep 25 10:42:24 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-ac4732fe-c7e9-4087-bffd-11571d468603 req-51dab0c4-7e28-42a4-a3e5-c176886b51b6 tempest-ServerActionsTestOtherA-1991731764 None] Terminate volume connection completed successfully. Sep 25 10:42:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-ac4732fe-c7e9-4087-bffd-11571d468603 req-51dab0c4-7e28-42a4-a3e5-c176886b51b6 tempest-ServerActionsTestOtherA-1991731764 None] Deleting attachment bc394f6e-204d-4a16-9249-e62521f85a7e. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:42:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bac8f229-89b1-4b7b-af96-51368e49a64b tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bac8f229-89b1-4b7b-af96-51368e49a64b tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bac8f229-89b1-4b7b-af96-51368e49a64b tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bac8f229-89b1-4b7b-af96-51368e49a64b tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bac8f229-89b1-4b7b-af96-51368e49a64b tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bac8f229-89b1-4b7b-af96-51368e49a64b tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:25 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:42:25 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:25 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bac8f229-89b1-4b7b-af96-51368e49a64b tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.489s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:25 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-bac8f229-89b1-4b7b-af96-51368e49a64b tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:25 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bac8f229-89b1-4b7b-af96-51368e49a64b tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Retype volume completed successfully. Sep 25 10:42:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:42:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:26 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:42:26 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:26 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.612s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:42:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:42:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:42:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Acquiring lock "cinder-7b93ea09-6155-4067-baec-e085bbbc7471-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Lock "cinder-7b93ea09-6155-4067-baec-e085bbbc7471-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Acquiring lock "cinder-quobyte-7b93ea09-6155-4067-baec-e085bbbc7471" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Lock "cinder-quobyte-7b93ea09-6155-4067-baec-e085bbbc7471" acquired by "delete_volume" :: waited 0.048s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:27 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d21568-a401-4e50-9cf3-73a54992ba7d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b93ea09-6155-4067-baec-e085bbbc7471 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:27 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b93ea09-6155-4067-baec-e085bbbc7471 Sep 25 10:42:27 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:27 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b93ea09-6155-4067-baec-e085bbbc7471" returned: 0 in 0.743s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b93ea09-6155-4067-baec-e085bbbc7471 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:28 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b93ea09-6155-4067-baec-e085bbbc7471 Sep 25 10:42:28 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:28 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b93ea09-6155-4067-baec-e085bbbc7471" returned: 0 in 0.600s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Lock "cinder-quobyte-7b93ea09-6155-4067-baec-e085bbbc7471" released by "delete_volume" :: held 1.466s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-ac4732fe-c7e9-4087-bffd-11571d468603 req-a76c43ed-61bd-49d4-963f-c4655821db88 tempest-ServerActionsTestOtherA-1991731764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-ac4732fe-c7e9-4087-bffd-11571d468603 req-a76c43ed-61bd-49d4-963f-c4655821db88 tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-ac4732fe-c7e9-4087-bffd-11571d468603 req-a76c43ed-61bd-49d4-963f-c4655821db88 tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:28 devstack cinder-volume[86874]: WARNING cinder.quota [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:42:28 devstack cinder-volume[86874]: WARNING cinder.quota [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:42:28 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Created reservations ['469e0eb0-e67a-41ba-996b-a55856f98ae9', '4ab5b227-9dd4-458f-ba82-9643afb96d79', 'c5327265-7d1f-41fe-a3fc-2af14f54e7ba', '042c0ca1-cdc8-484a-bc9d-26b6f87ba5c1'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-ac4732fe-c7e9-4087-bffd-11571d468603 req-a76c43ed-61bd-49d4-963f-c4655821db88 tempest-ServerActionsTestOtherA-1991731764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-59b14a6e-38ab-43d0-b982-c9e324cafb67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '428beedd-6c37-4a82-a082-45f185e205d1', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:42:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:29 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:42:29 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:29 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-ac4732fe-c7e9-4087-bffd-11571d468603 req-a76c43ed-61bd-49d4-963f-c4655821db88 tempest-ServerActionsTestOtherA-1991731764 None] attachment_update completed successfully. Sep 25 10:42:29 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.473s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:29 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:29 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Deleted volume successfully. Sep 25 10:42:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b887de21-adc0-4769-9ba2-393c0dbaca0a tempest-VolumeRetypeWithoutMigrationTest-1260663428 None] Lock "cinder-7b93ea09-6155-4067-baec-e085bbbc7471-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:39 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=1,cinder:SELECT=17 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:42:39 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=26,cinder:UPDATE=18,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Flow 'volume_create_manager' (35a3d98b-98f7-4ef1-9be4-5c53703b01ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2471f9-2be0-47bd-8175-520b9831b990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2471f9-2be0-47bd-8175-520b9831b990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-828999602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f61ebe1-d3e9-4a66-b815-b1f1830f14de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86123c92720744259a6ce4f84189d8a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:46Z,use_quota=True,user_id='c462dc80e30e4508ade52f698b6acff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fd3337-594b-444f-9997-e28505565222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fd3337-594b-444f-9997-e28505565222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0656aae5-1c7f-4291-8d89-1f66b9cbbf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0656aae5-1c7f-4291-8d89-1f66b9cbbf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f61ebe1-d3e9-4a66-b815-b1f1830f14de', 'volume_name': 'volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3633bc91-d473-4934-afab-7fbf8dd10291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3633bc91-d473-4934-afab-7fbf8dd10291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1026e8f0-37eb-4166-96e7-c36e1c64d72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:45 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Volume 4f61ebe1-d3e9-4a66-b815-b1f1830f14de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de', 'volume_size': 1} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-828999602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f61ebe1-d3e9-4a66-b815-b1f1830f14de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86123c92720744259a6ce4f84189d8a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:46Z,use_quota=True,user_id='c462dc80e30e4508ade52f698b6acff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Creating volume 4f61ebe1-d3e9-4a66-b815-b1f1830f14de {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:45 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:42:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:46 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de 1073741824 Sep 25 10:42:46 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:46 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de 1073741824" returned: 0 in 0.992s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:47 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de Sep 25 10:42:47 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:47 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de" returned: 0 in 0.691s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:42:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1026e8f0-37eb-4166-96e7-c36e1c64d72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a529aef6-0da8-4697-99a9-d731cc53e7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:47 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Volume volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de (4f61ebe1-d3e9-4a66-b815-b1f1830f14de): created successfully Sep 25 10:42:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a529aef6-0da8-4697-99a9-d731cc53e7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Flow 'volume_create_manager' (35a3d98b-98f7-4ef1-9be4-5c53703b01ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:47 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-684c2a62-5bb9-424e-8d37-da57ae936fa7 tempest-VolumesServicesTestJSON-1311451274 None] Created volume successfully. Sep 25 10:42:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Acquiring lock "cinder-4f61ebe1-d3e9-4a66-b815-b1f1830f14de-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Lock "cinder-4f61ebe1-d3e9-4a66-b815-b1f1830f14de-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Acquiring lock "cinder-quobyte-4f61ebe1-d3e9-4a66-b815-b1f1830f14de" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Lock "cinder-quobyte-4f61ebe1-d3e9-4a66-b815-b1f1830f14de" acquired by "delete_volume" :: waited 0.052s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:49 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b501f5a0-2917-4f3e-b5f5-8bd6e5d08433]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:49 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de Sep 25 10:42:49 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:50 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de" returned: 0 in 0.791s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:50 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de Sep 25 10:42:50 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:50 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4f61ebe1-d3e9-4a66-b815-b1f1830f14de" returned: 0 in 0.661s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Lock "cinder-quobyte-4f61ebe1-d3e9-4a66-b815-b1f1830f14de" released by "delete_volume" :: held 1.590s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:51 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Created reservations ['c20294a6-8d34-4560-b327-70a1d9304a2c', '824c0d05-7820-4996-b5af-1411cdfb79e3', '7e77a031-6a54-4a8f-83c5-60dc69711924', '67cdf37e-146f-4125-a3ee-4f67da4dff4f'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:51 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:42:51 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:51 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.564s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:51 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:51 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Deleted volume successfully. Sep 25 10:42:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-27542356-69a0-4370-b65a-24c56de67740 tempest-VolumesServicesTestJSON-1311451274 None] Lock "cinder-4f61ebe1-d3e9-4a66-b815-b1f1830f14de-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Flow 'volume_create_manager' (34257453-0fda-4304-8d41-90587bcec2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37bdb6f7-d16f-4c61-8619-3d95c9d3697c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37bdb6f7-d16f-4c61-8619-3d95c9d3697c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-334455586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd38dbe6-c3b2-4146-a5f2-c6b55f47f936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b27acc2ab3c4f2e86b4a1d530524578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:56Z,use_quota=True,user_id='cbea6d67b5db43159dda8ed029895a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305e5a0e-bb25-49b5-9860-ef7fe1665c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305e5a0e-bb25-49b5-9860-ef7fe1665c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826ce298-a912-4be9-a5a6-b0a0a7df1f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826ce298-a912-4be9-a5a6-b0a0a7df1f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd38dbe6-c3b2-4146-a5f2-c6b55f47f936', 'volume_name': 'volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1904be-358d-4c4b-8740-a798bbd49614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1904be-358d-4c4b-8740-a798bbd49614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd3221a-71bd-4863-8652-dee496822ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:56 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Volume bd38dbe6-c3b2-4146-a5f2-c6b55f47f936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936', 'volume_size': 1} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-334455586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd38dbe6-c3b2-4146-a5f2-c6b55f47f936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b27acc2ab3c4f2e86b4a1d530524578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:56Z,use_quota=True,user_id='cbea6d67b5db43159dda8ed029895a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Creating volume bd38dbe6-c3b2-4146-a5f2-c6b55f47f936 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:56 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:56 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936 1073741824 Sep 25 10:42:56 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Acquiring lock "cinder-e4e220af-7986-41e2-a85b-700db580b6d0-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Lock "cinder-e4e220af-7986-41e2-a85b-700db580b6d0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Acquiring lock "cinder-quobyte-e4e220af-7986-41e2-a85b-700db580b6d0" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Lock "cinder-quobyte-e4e220af-7986-41e2-a85b-700db580b6d0" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2ec0f9-fd85-4c9c-8e1c-1e5954cfe596]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e4e220af-7986-41e2-a85b-700db580b6d0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:56 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e4e220af-7986-41e2-a85b-700db580b6d0 Sep 25 10:42:56 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:56 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936 1073741824" returned: 0 in 0.580s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:56 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936 Sep 25 10:42:56 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:56 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e4e220af-7986-41e2-a85b-700db580b6d0" returned: 0 in 0.486s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e4e220af-7986-41e2-a85b-700db580b6d0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:57 devstack sudo[92597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e4e220af-7986-41e2-a85b-700db580b6d0 Sep 25 10:42:57 devstack sudo[92597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:57 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936" returned: 0 in 0.335s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd3221a-71bd-4863-8652-dee496822ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b2bbd3-588a-4821-a0c9-c17fe016b4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:57 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Volume volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936 (bd38dbe6-c3b2-4146-a5f2-c6b55f47f936): created successfully Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b2bbd3-588a-4821-a0c9-c17fe016b4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Flow 'volume_create_manager' (34257453-0fda-4304-8d41-90587bcec2b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:57 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6a7ba6be-0a0c-4654-a551-09c1cda91c28 tempest-TaggedAttachmentsTest-48632209 None] Created volume successfully. Sep 25 10:42:57 devstack sudo[92597]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e4e220af-7986-41e2-a85b-700db580b6d0" returned: 0 in 0.328s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Lock "cinder-quobyte-e4e220af-7986-41e2-a85b-700db580b6d0" released by "delete_volume" :: held 0.881s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Created reservations ['451c9e0e-29bb-4b4a-80aa-09b3399e6960', 'b7784528-3951-47fc-98d7-3bb4f83a789d', '7d15889c-eb77-4e21-828c-883e257c0ae1', '9b48dbef-dc80-4d79-8936-94def5e2e0bb'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:57 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:42:57 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:57 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.289s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:57 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Deleted volume successfully. Sep 25 10:42:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d3b80cc8-04c8-4891-a685-05634e4af273 tempest-AttachVolumeShelveTestJSON-245439624 None] Lock "cinder-e4e220af-7986-41e2-a85b-700db580b6d0-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:07 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=15,cinder:UPDATE=19,cinder:INSERT=6 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:43:07 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=13,cinder:UPDATE=25,cinder:INSERT=4,cinder:DELETE=4 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Flow 'volume_create_manager' (27e0bda3-6379-4b54-883c-ca37c7eba9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e6ca81-06fe-4e69-b407-8530926e2353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e6ca81-06fe-4e69-b407-8530926e2353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1992479285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb94f14-1436-4443-90f0-199346c1d505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1be3f90226fe409ca66cb4c7c6753e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:12Z,use_quota=True,user_id='0ee609c800b949e2b804c15fcf4564fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2b6190b-0903-4846-9740-acccb2df703e),volume_type_id=b2b6190b-0903-4846-9740-acccb2df703e)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0a732b-f5a7-4243-8a6d-2aaeaee9f310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0a732b-f5a7-4243-8a6d-2aaeaee9f310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448ff201-bae0-4deb-832c-90fd5e5e1c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448ff201-bae0-4deb-832c-90fd5e5e1c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb94f14-1436-4443-90f0-199346c1d505', 'volume_name': 'volume-1bb94f14-1436-4443-90f0-199346c1d505', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d07a5c-51d4-41e5-bc16-7f825adcbaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d07a5c-51d4-41e5-bc16-7f825adcbaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784c8207-0ea3-4640-859a-3891619bcbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:12 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Volume 1bb94f14-1436-4443-90f0-199346c1d505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb94f14-1436-4443-90f0-199346c1d505', 'volume_size': 1} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1992479285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb94f14-1436-4443-90f0-199346c1d505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1be3f90226fe409ca66cb4c7c6753e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:12Z,use_quota=True,user_id='0ee609c800b949e2b804c15fcf4564fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2b6190b-0903-4846-9740-acccb2df703e),volume_type_id=b2b6190b-0903-4846-9740-acccb2df703e)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Creating volume 1bb94f14-1436-4443-90f0-199346c1d505 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:43:12 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:43:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1bb94f14-1436-4443-90f0-199346c1d505 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:12 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1bb94f14-1436-4443-90f0-199346c1d505 1073741824 Sep 25 10:43:12 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-f2599c39-380d-478c-a801-ec137515465d req-01b89f17-e7ea-430c-800a-4cd4377d4807 tempest-ServerActionsTestOtherA-1991731764 None] Terminate volume connection completed successfully. Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-f2599c39-380d-478c-a801-ec137515465d req-01b89f17-e7ea-430c-800a-4cd4377d4807 tempest-ServerActionsTestOtherA-1991731764 None] Deleting attachment 428beedd-6c37-4a82-a082-45f185e205d1. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:43:13 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1bb94f14-1436-4443-90f0-199346c1d505 1073741824" returned: 0 in 0.671s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1bb94f14-1436-4443-90f0-199346c1d505 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:13 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1bb94f14-1436-4443-90f0-199346c1d505 Sep 25 10:43:13 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Acquiring lock "cinder-59b14a6e-38ab-43d0-b982-c9e324cafb67-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Lock "cinder-59b14a6e-38ab-43d0-b982-c9e324cafb67-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Acquiring lock "cinder-quobyte-59b14a6e-38ab-43d0-b982-c9e324cafb67" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Lock "cinder-quobyte-59b14a6e-38ab-43d0-b982-c9e324cafb67" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[400b7ca9-8fa5-44e7-baa7-6687e255918e]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:13 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1bb94f14-1436-4443-90f0-199346c1d505" returned: 0 in 0.467s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784c8207-0ea3-4640-859a-3891619bcbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb94f14-1436-4443-90f0-199346c1d505', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60494167-6ed2-44e7-9039-a9eac7f35cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:13 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Volume volume-1bb94f14-1436-4443-90f0-199346c1d505 (1bb94f14-1436-4443-90f0-199346c1d505): created successfully Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60494167-6ed2-44e7-9039-a9eac7f35cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Flow 'volume_create_manager' (27e0bda3-6379-4b54-883c-ca37c7eba9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:13 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 Sep 25 10:43:13 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-0f76cfdf-00e9-47a0-aea7-08fbd6b7f876 tempest-VolumeTypesAccessTest-30252032 None] Created volume successfully. Sep 25 10:43:14 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67" returned: 0 in 0.587s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:14 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67 Sep 25 10:43:14 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:14 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-59b14a6e-38ab-43d0-b982-c9e324cafb67" returned: 0 in 0.425s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Lock "cinder-quobyte-59b14a6e-38ab-43d0-b982-c9e324cafb67" released by "delete_volume" :: held 1.164s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:14 devstack cinder-volume[86874]: DEBUG cinder.quota [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Created reservations ['8422c6d5-b964-4811-ade0-830aa7aeb059', '641f0472-bdce-461d-81d9-72c2666ee418', '0e4ae561-ed7b-4236-a11c-cf6d1ea11989', '09c92d8a-6c2a-4802-a594-294cc4703747'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:43:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Acquiring lock "cinder-437de506-8d18-4173-b8df-03b27be4c16a-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Acquiring lock "cinder-1bb94f14-1436-4443-90f0-199346c1d505-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Lock "cinder-437de506-8d18-4173-b8df-03b27be4c16a-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Lock "cinder-1bb94f14-1436-4443-90f0-199346c1d505-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Acquiring lock "cinder-quobyte-437de506-8d18-4173-b8df-03b27be4c16a" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Lock "cinder-quobyte-437de506-8d18-4173-b8df-03b27be4c16a" acquired by "delete_volume" :: waited 0.045s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:15 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:43:15 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d6c734-d2cc-4565-82c0-c152fc41f425]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-437de506-8d18-4173-b8df-03b27be4c16a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Acquiring lock "cinder-quobyte-1bb94f14-1436-4443-90f0-199346c1d505" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Lock "cinder-quobyte-1bb94f14-1436-4443-90f0-199346c1d505" acquired by "delete_volume" :: waited 0.049s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:15 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-437de506-8d18-4173-b8df-03b27be4c16a Sep 25 10:43:15 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7a47af-e61b-4bbf-ae51-1e81a9cd7c22]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1bb94f14-1436-4443-90f0-199346c1d505 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:15 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1bb94f14-1436-4443-90f0-199346c1d505 Sep 25 10:43:15 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:15 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.622s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG cinder.manager [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:43:15 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Deleted volume successfully. Sep 25 10:43:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-f2599c39-380d-478c-a801-ec137515465d req-099f0f7c-56a2-435e-8b8e-c0307fa10755 tempest-ServerActionsTestOtherA-1991731764 None] Lock "cinder-59b14a6e-38ab-43d0-b982-c9e324cafb67-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:16 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-437de506-8d18-4173-b8df-03b27be4c16a" returned: 0 in 0.806s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-437de506-8d18-4173-b8df-03b27be4c16a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:16 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-437de506-8d18-4173-b8df-03b27be4c16a Sep 25 10:43:16 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:16 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1bb94f14-1436-4443-90f0-199346c1d505" returned: 0 in 0.902s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1bb94f14-1436-4443-90f0-199346c1d505 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:16 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1bb94f14-1436-4443-90f0-199346c1d505 Sep 25 10:43:16 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:16 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-437de506-8d18-4173-b8df-03b27be4c16a" returned: 0 in 0.418s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Lock "cinder-quobyte-437de506-8d18-4173-b8df-03b27be4c16a" released by "delete_volume" :: held 1.292s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Created reservations ['cf9d014e-98e4-44a8-882f-96272bf48fcb', '89ff7ff9-f15f-4277-8010-cd076cfad2dd', '51c96863-db4f-40b5-a27b-f379be77f57d', '76202c62-7ea4-47e2-a77a-af5dfa2e2eb8'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:43:16 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1bb94f14-1436-4443-90f0-199346c1d505" returned: 0 in 0.317s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Lock "cinder-quobyte-1bb94f14-1436-4443-90f0-199346c1d505" released by "delete_volume" :: held 1.351s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:16 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:43:16 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:16 devstack cinder-volume[86874]: WARNING cinder.quota [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1392030613 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1392030613, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:43:16 devstack cinder-volume[86874]: WARNING cinder.quota [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1392030613 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1392030613, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Created reservations ['3aa6cf5d-3f02-4251-98f5-6550e1bfe512', 'b70fb733-649d-4712-8d0d-7326e4eabf57', '3195840d-d609-40b4-a243-d6d57d7279ec', 'ed1a04ad-b8cb-43c7-8a41-b7fb1b832e47'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:16 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:43:16 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:17 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.406s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:17 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:43:17 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Deleted volume successfully. Sep 25 10:43:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f85d1ba1-dfee-430c-8d06-2fcec25ffd39 tempest-ServerActionsTestOtherA-1991731764 None] Lock "cinder-437de506-8d18-4173-b8df-03b27be4c16a-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:17 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.673s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:17 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:43:17 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Deleted volume successfully. Sep 25 10:43:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0875ae8b-ba4d-4bf2-bd18-70ff418e4b00 tempest-VolumeTypesAccessTest-30252032 None] Lock "cinder-1bb94f14-1436-4443-90f0-199346c1d505-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:43:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:26 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:43:26 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:26 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.454s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:43:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:43:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:43:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:43:27 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=34,cinder:SELECT=17,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:43:27 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=19,cinder:INSERT=7,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:43:48 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:44:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-ca9a3eb2-ea61-45ad-99b0-56b489c8164f req-b9c6ba3f-4240-479f-9073-bc50a0a6ac19 tempest-TaggedAttachmentsTest-48632209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-ca9a3eb2-ea61-45ad-99b0-56b489c8164f req-b9c6ba3f-4240-479f-9073-bc50a0a6ac19 tempest-TaggedAttachmentsTest-48632209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-ca9a3eb2-ea61-45ad-99b0-56b489c8164f req-b9c6ba3f-4240-479f-9073-bc50a0a6ac19 tempest-TaggedAttachmentsTest-48632209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-ca9a3eb2-ea61-45ad-99b0-56b489c8164f req-b9c6ba3f-4240-479f-9073-bc50a0a6ac19 tempest-TaggedAttachmentsTest-48632209 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c9cba0e-87bc-4e2f-a3d2-894dc3a91e95', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:44:05 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-ca9a3eb2-ea61-45ad-99b0-56b489c8164f req-b9c6ba3f-4240-479f-9073-bc50a0a6ac19 tempest-TaggedAttachmentsTest-48632209 None] attachment_update completed successfully. Sep 25 10:44:09 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-706a29f5-d7e0-43da-aba8-4e3e5dc6a7c9 req-bace5c53-1a34-4dc1-a413-697687a990bc tempest-TaggedAttachmentsTest-48632209 None] Terminate volume connection completed successfully. Sep 25 10:44:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-706a29f5-d7e0-43da-aba8-4e3e5dc6a7c9 req-bace5c53-1a34-4dc1-a413-697687a990bc tempest-TaggedAttachmentsTest-48632209 None] Deleting attachment 7c9cba0e-87bc-4e2f-a3d2-894dc3a91e95. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Flow 'volume_create_manager' (cf1e4d2c-6337-4c4e-ae54-e721ffd202b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c21c65-c057-4ca3-b6dc-99c0939dd0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c21c65-c057-4ca3-b6dc-99c0939dd0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-983781104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a54aad-6c25-4674-be94-e66003bb56cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63994288099245f8ad956a38ba818f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:12Z,use_quota=True,user_id='ebf7c7dbe3124a3c966661d4b6382504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdefe33e-d8e2-4794-87ea-306525247211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdefe33e-d8e2-4794-87ea-306525247211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad1a7c9-fa5f-4909-8ee4-9e3ce7480421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad1a7c9-fa5f-4909-8ee4-9e3ce7480421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a54aad-6c25-4674-be94-e66003bb56cb', 'volume_name': 'volume-f6a54aad-6c25-4674-be94-e66003bb56cb', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f34110-d383-49d5-b7d5-04b185e37a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f34110-d383-49d5-b7d5-04b185e37a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0b3276-f1aa-4825-aca2-6c2275e1e451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:12 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Volume f6a54aad-6c25-4674-be94-e66003bb56cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a54aad-6c25-4674-be94-e66003bb56cb', 'volume_size': 1} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-983781104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a54aad-6c25-4674-be94-e66003bb56cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63994288099245f8ad956a38ba818f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:12Z,use_quota=True,user_id='ebf7c7dbe3124a3c966661d4b6382504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Creating volume f6a54aad-6c25-4674-be94-e66003bb56cb {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:44:12 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:44:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:12 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb 1073741824 Sep 25 10:44:12 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:13 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb 1073741824" returned: 0 in 0.948s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:13 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb Sep 25 10:44:13 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:14 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb" returned: 0 in 0.434s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:44:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0b3276-f1aa-4825-aca2-6c2275e1e451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a54aad-6c25-4674-be94-e66003bb56cb', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf492ac-bdc8-44fd-8669-d8b23d4bbecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:14 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Volume volume-f6a54aad-6c25-4674-be94-e66003bb56cb (f6a54aad-6c25-4674-be94-e66003bb56cb): created successfully Sep 25 10:44:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf492ac-bdc8-44fd-8669-d8b23d4bbecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Flow 'volume_create_manager' (cf1e4d2c-6337-4c4e-ae54-e721ffd202b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:14 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-100bb175-522b-4329-8f15-bb8470850256 tempest-SnapshotMetadataTestJSON-96382323 None] Created volume successfully. Sep 25 10:44:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] Creating offline snapshot 20e0eb87-44da-45d4-8901-d3510595698f of volume f6a54aad-6c25-4674-be94-e66003bb56cb {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:44:15 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad5b496-5b8d-4f87-bea4-72a4a907e1fc]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:16 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb Sep 25 10:44:16 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:16 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:44:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Flow 'volume_create_manager' (44eb96a2-9978-4606-94ba-0ad340a1c4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a80d060-bf2b-4b06-bb48-f84081481731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a80d060-bf2b-4b06-bb48-f84081481731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1169979734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344f20ef-1beb-40a3-85d9-595fbbb733fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5007e87c0a54a34a4fa34d76dd8ea2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:16Z,use_quota=True,user_id='4fd1ace02e3e46a09d32d07e1be07550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e73af0d-98ec-4bc2-b934-d0dc9febe0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e73af0d-98ec-4bc2-b934-d0dc9febe0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f834a62c-4323-475f-b158-e9d3a46336bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f834a62c-4323-475f-b158-e9d3a46336bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '344f20ef-1beb-40a3-85d9-595fbbb733fc', 'volume_name': 'volume-344f20ef-1beb-40a3-85d9-595fbbb733fc', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f90629-c74a-4af4-b2b1-7e957f331a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f90629-c74a-4af4-b2b1-7e957f331a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:16 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119c1019-ad1a-4c57-b466-78326bbac1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:16 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Volume 344f20ef-1beb-40a3-85d9-595fbbb733fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-344f20ef-1beb-40a3-85d9-595fbbb733fc', 'volume_size': 1} Sep 25 10:44:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb" returned: 0 in 1.040s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:16 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f 1G Sep 25 10:44:16 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:17 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f 1G" returned: 0 in 0.834s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a54aad-6c25-4674-be94-e66003bb56cb -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:17 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a54aad-6c25-4674-be94-e66003bb56cb -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f Sep 25 10:44:17 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:18 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a54aad-6c25-4674-be94-e66003bb56cb -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f" returned: 0 in 0.525s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:18 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f is being set with open permissions: ugo+rw Sep 25 10:44:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:18 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f Sep 25 10:44:18 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:18 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f" returned: 0 in 0.576s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:18 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.info Sep 25 10:44:18 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:19 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.info" returned: 0 in 0.427s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:19 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.info is being set with open permissions: ugo+rw Sep 25 10:44:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:19 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.info Sep 25 10:44:19 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:19 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.info" returned: 0 in 0.443s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.131s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.024s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1169979734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344f20ef-1beb-40a3-85d9-595fbbb733fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5007e87c0a54a34a4fa34d76dd8ea2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:16Z,use_quota=True,user_id='4fd1ace02e3e46a09d32d07e1be07550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:44:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Creating volume 344f20ef-1beb-40a3-85d9-595fbbb733fc {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:44:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:44:19 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:44:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-344f20ef-1beb-40a3-85d9-595fbbb733fc 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:19 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-344f20ef-1beb-40a3-85d9-595fbbb733fc 1073741824 Sep 25 10:44:19 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:19 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-035be78f-d07a-412b-aa9e-40fbebb03f32 tempest-SnapshotMetadataTestJSON-96382323 None] Create snapshot completed successfully Sep 25 10:44:20 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-344f20ef-1beb-40a3-85d9-595fbbb733fc 1073741824" returned: 0 in 0.821s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-344f20ef-1beb-40a3-85d9-595fbbb733fc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:20 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-344f20ef-1beb-40a3-85d9-595fbbb733fc Sep 25 10:44:20 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:21 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-344f20ef-1beb-40a3-85d9-595fbbb733fc" returned: 0 in 0.514s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:44:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119c1019-ad1a-4c57-b466-78326bbac1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-344f20ef-1beb-40a3-85d9-595fbbb733fc', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a59480d-5887-4991-819b-178f5c82ce3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:21 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Volume volume-344f20ef-1beb-40a3-85d9-595fbbb733fc (344f20ef-1beb-40a3-85d9-595fbbb733fc): created successfully Sep 25 10:44:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a59480d-5887-4991-819b-178f5c82ce3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Flow 'volume_create_manager' (44eb96a2-9978-4606-94ba-0ad340a1c4c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:21 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5e1e4719-2bbe-4192-99d0-77ff4cc06d6e tempest-AttachVolumeNegativeTest-950702000 None] Created volume successfully. Sep 25 10:44:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Acquiring lock "cinder-20e0eb87-44da-45d4-8901-d3510595698f-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Lock "cinder-20e0eb87-44da-45d4-8901-d3510595698f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Acquiring lock "cinder-quobyte-f6a54aad-6c25-4674-be94-e66003bb56cb" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Lock "cinder-quobyte-f6a54aad-6c25-4674-be94-e66003bb56cb" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Acquiring lock "cinder-quobyte-20e0eb87-44da-45d4-8901-d3510595698f" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Lock "cinder-quobyte-20e0eb87-44da-45d4-8901-d3510595698f" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Deleting offline snapshot 20e0eb87-44da-45d4-8901-d3510595698f of volume f6a54aad-6c25-4674-be94-e66003bb56cb {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:44:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] snapshot_file for this snap is: volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:44:22 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[96897fd9-10d8-4a1f-942b-ea308fdf62fb]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:23 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f Sep 25 10:44:23 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-678e92d1-b8b1-4687-a981-42dbfec9a21d req-3839894c-edc4-4cca-87c3-67c6a6ffe12f tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-678e92d1-b8b1-4687-a981-42dbfec9a21d req-3839894c-edc4-4cca-87c3-67c6a6ffe12f tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-678e92d1-b8b1-4687-a981-42dbfec9a21d req-3839894c-edc4-4cca-87c3-67c6a6ffe12f tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:23 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-678e92d1-b8b1-4687-a981-42dbfec9a21d req-3839894c-edc4-4cca-87c3-67c6a6ffe12f tempest-AttachVolumeNegativeTest-950702000 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-344f20ef-1beb-40a3-85d9-595fbbb733fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1f8e6c3-f056-4b90-8903-4c1bfc10b209', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:44:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f" returned: 0 in 0.828s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6a54aad-6c25-4674-be94-e66003bb56cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:44:23 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b751c767-4cca-4fad-aeae-2c58fa25890a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-678e92d1-b8b1-4687-a981-42dbfec9a21d req-3839894c-edc4-4cca-87c3-67c6a6ffe12f tempest-AttachVolumeNegativeTest-950702000 None] attachment_update completed successfully. Sep 25 10:44:24 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb Sep 25 10:44:24 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:24 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb" returned: 0 in 0.682s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:24 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f Sep 25 10:44:24 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Acquiring lock "cinder-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Lock "cinder-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:25 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f" returned: 0 in 1.135s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:25 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f Sep 25 10:44:25 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Acquiring lock "cinder-quobyte-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Lock "cinder-quobyte-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936" acquired by "delete_volume" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:25 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[601bdb77-ba4a-435f-90d9-4b74476155da]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:26 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb.20e0eb87-44da-45d4-8901-d3510595698f" returned: 0 in 0.373s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:26 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936 Sep 25 10:44:26 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Lock "cinder-quobyte-20e0eb87-44da-45d4-8901-d3510595698f" released by "_delete_snapshot" :: held 3.283s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Lock "cinder-quobyte-f6a54aad-6c25-4674-be94-e66003bb56cb" released by "delete_snapshot" :: held 3.338s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:26 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:44:26 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:26 devstack cinder-volume[86874]: WARNING cinder.quota [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Created reservations ['71b3264b-8645-420e-9e04-6c5cec3898ae', 'f1242600-cf59-40b7-ae94-d148e9fd792c', '6d853c63-74b2-4e33-a797-f18aa70cfcdc', '2ed1917a-3e9b-4cb4-81c2-289d4c0005bb'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:26 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Delete snapshot completed successfully. Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a1ed99b9-3551-4c21-9db2-0cdcd4ad3b1d tempest-SnapshotMetadataTestJSON-96382323 None] Lock "cinder-20e0eb87-44da-45d4-8901-d3510595698f-delete_snapshot" released by "delete_snapshot" :: held 3.618s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:26 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936" returned: 0 in 0.643s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:26 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936 Sep 25 10:44:26 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:26 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.475s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:44:26 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936" returned: 0 in 0.390s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Lock "cinder-quobyte-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936" released by "delete_volume" :: held 1.101s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:26 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Created reservations ['7d0570a6-fbb1-4af2-9f39-67519b1b61d6', '0e6e8d80-fa95-4b68-a36a-5cf2a2e73db1', '88853be0-e748-43d7-a548-0f5bcbc9b0e3', '9b3b0c19-28ed-4161-8d4b-0855fbffed70'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:27 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:44:27 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Acquiring lock "cinder-f6a54aad-6c25-4674-be94-e66003bb56cb-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Lock "cinder-f6a54aad-6c25-4674-be94-e66003bb56cb-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Acquiring lock "cinder-quobyte-f6a54aad-6c25-4674-be94-e66003bb56cb" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Lock "cinder-quobyte-f6a54aad-6c25-4674-be94-e66003bb56cb" acquired by "delete_volume" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3cc27b-0cc9-481b-b9bf-6d22351450a9]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:27 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.437s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:44:27 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Deleted volume successfully. Sep 25 10:44:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b2c8811c-f6fe-4489-9b33-3ea42cb93aed tempest-TaggedAttachmentsTest-48632209 None] Lock "cinder-bd38dbe6-c3b2-4146-a5f2-c6b55f47f936-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:27 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb Sep 25 10:44:27 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:28 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb" returned: 0 in 0.566s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:28 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb Sep 25 10:44:28 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:28 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f6a54aad-6c25-4674-be94-e66003bb56cb" returned: 0 in 0.423s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Lock "cinder-quobyte-f6a54aad-6c25-4674-be94-e66003bb56cb" released by "delete_volume" :: held 1.124s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:28 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Created reservations ['26b29ca5-5622-43d1-802a-c2c4a9dd3a0c', '957034d3-1106-4026-9df1-8b03167c8be1', '2a3facc9-cbef-494e-9197-03e0615a0a54', '7bc2b50e-fd38-414f-b38b-9277f1b73e76'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:28 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:44:28 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:29 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.353s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:29 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:44:29 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Deleted volume successfully. Sep 25 10:44:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2640750c-1fb1-4b97-8d9f-353bf2c196f8 tempest-SnapshotMetadataTestJSON-96382323 None] Lock "cinder-f6a54aad-6c25-4674-be94-e66003bb56cb-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:38 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=40,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:44:39 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=34,cinder:UPDATE=34,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:44:46 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:44:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Flow 'volume_create_manager' (9f3c753c-df9f-4746-81bb-13f369bb5826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc430d4-729b-48fc-b58d-7fe9016eaffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc430d4-729b-48fc-b58d-7fe9016eaffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-447116063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e708ae3-c2d3-4fad-872a-ef94bc948299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353111e8abc74f369aa3088638f3553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:47Z,use_quota=True,user_id='469f16f7339c483cb3856ec3e35e5a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f6786d2-189b-49e3-8ae8-b2925b676d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f6786d2-189b-49e3-8ae8-b2925b676d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f78dc88-a295-43f4-b17e-42b1e32df515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f78dc88-a295-43f4-b17e-42b1e32df515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e708ae3-c2d3-4fad-872a-ef94bc948299', 'volume_name': 'volume-4e708ae3-c2d3-4fad-872a-ef94bc948299', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f6531c-2c6c-4f86-a3d1-f3ccd71b285f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f6531c-2c6c-4f86-a3d1-f3ccd71b285f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdddd39-d977-40ff-9c12-6aa267be2a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:47 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Volume 4e708ae3-c2d3-4fad-872a-ef94bc948299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e708ae3-c2d3-4fad-872a-ef94bc948299', 'volume_size': 1} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-447116063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e708ae3-c2d3-4fad-872a-ef94bc948299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353111e8abc74f369aa3088638f3553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:47Z,use_quota=True,user_id='469f16f7339c483cb3856ec3e35e5a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Creating volume 4e708ae3-c2d3-4fad-872a-ef94bc948299 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:44:47 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4e708ae3-c2d3-4fad-872a-ef94bc948299 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:47 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4e708ae3-c2d3-4fad-872a-ef94bc948299 1073741824 Sep 25 10:44:47 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:47 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4e708ae3-c2d3-4fad-872a-ef94bc948299 1073741824" returned: 0 in 0.757s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4e708ae3-c2d3-4fad-872a-ef94bc948299 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:48 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4e708ae3-c2d3-4fad-872a-ef94bc948299 Sep 25 10:44:48 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:48 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4e708ae3-c2d3-4fad-872a-ef94bc948299" returned: 0 in 0.550s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:44:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdddd39-d977-40ff-9c12-6aa267be2a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e708ae3-c2d3-4fad-872a-ef94bc948299', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f452d785-feda-477b-bc1a-b679d1bace79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:48 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Volume volume-4e708ae3-c2d3-4fad-872a-ef94bc948299 (4e708ae3-c2d3-4fad-872a-ef94bc948299): created successfully Sep 25 10:44:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f452d785-feda-477b-bc1a-b679d1bace79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Flow 'volume_create_manager' (9f3c753c-df9f-4746-81bb-13f369bb5826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:48 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-60e31f72-a210-493b-8528-04538f3127d1 tempest-AttachVolumeTestJSON-1139818827 None] Created volume successfully. Sep 25 10:44:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-47edd76d-6857-4dc0-9fc6-220c5555dcd7 req-05d343aa-7d55-4493-9b05-bf72670c84b7 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-47edd76d-6857-4dc0-9fc6-220c5555dcd7 req-05d343aa-7d55-4493-9b05-bf72670c84b7 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-47edd76d-6857-4dc0-9fc6-220c5555dcd7 req-05d343aa-7d55-4493-9b05-bf72670c84b7 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:50 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-47edd76d-6857-4dc0-9fc6-220c5555dcd7 req-05d343aa-7d55-4493-9b05-bf72670c84b7 tempest-AttachVolumeTestJSON-1139818827 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-4e708ae3-c2d3-4fad-872a-ef94bc948299', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03a5d9bb-cc51-4544-aaa4-0a6a81af35e6', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:44:50 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-47edd76d-6857-4dc0-9fc6-220c5555dcd7 req-05d343aa-7d55-4493-9b05-bf72670c84b7 tempest-AttachVolumeTestJSON-1139818827 None] attachment_update completed successfully. Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Flow 'volume_create_manager' (ac20e2f6-9448-4382-9ff4-89c24821ef46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769cf678-5271-45da-a981-2b11838ff367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769cf678-5271-45da-a981-2b11838ff367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-232376664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dee0ed1-a778-43bc-8f6c-38f84ab64842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11653d57ca18420c9aa3e898ebb813f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:53Z,use_quota=True,user_id='35dbede7f00d4919b4958002cafc5553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8590173c-b71f-4fec-9194-2e848a2c7775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8590173c-b71f-4fec-9194-2e848a2c7775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a9fd41-8a5e-462f-a975-3c01d32eafd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a9fd41-8a5e-462f-a975-3c01d32eafd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dee0ed1-a778-43bc-8f6c-38f84ab64842', 'volume_name': 'volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6d749b-913b-4b0b-8ed1-8b83a4bfaac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6d749b-913b-4b0b-8ed1-8b83a4bfaac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6310449-c46d-4ab0-9df3-83864951bd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:52 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Volume 9dee0ed1-a778-43bc-8f6c-38f84ab64842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842', 'volume_size': 1} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-232376664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dee0ed1-a778-43bc-8f6c-38f84ab64842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11653d57ca18420c9aa3e898ebb813f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:53Z,use_quota=True,user_id='35dbede7f00d4919b4958002cafc5553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Creating volume 9dee0ed1-a778-43bc-8f6c-38f84ab64842 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:44:52 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:44:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:53 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 1073741824 Sep 25 10:44:53 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:53 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 1073741824" returned: 0 in 0.808s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:53 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 Sep 25 10:44:53 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:54 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842" returned: 0 in 0.486s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:44:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6310449-c46d-4ab0-9df3-83864951bd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca2587d-6900-4359-a47f-7a4f41d32e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:54 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Volume volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 (9dee0ed1-a778-43bc-8f6c-38f84ab64842): created successfully Sep 25 10:44:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca2587d-6900-4359-a47f-7a4f41d32e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Flow 'volume_create_manager' (ac20e2f6-9448-4382-9ff4-89c24821ef46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:54 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-91f12efd-d777-4dba-b942-9d44c264a7db req-cf9aa86f-75cf-47c1-9949-988f39282299 tempest-VolumesSnapshotsTestJSON-633239273 None] Created volume successfully. Sep 25 10:44:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] Creating offline snapshot 6ed3bb2e-ff3b-4d24-9473-763f06be8fad of volume 9dee0ed1-a778-43bc-8f6c-38f84ab64842 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:44:55 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2af8050-d7bc-471d-a004-6f71e728b27b]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:56 devstack sudo[94506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 Sep 25 10:44:56 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:56 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842" returned: 0 in 0.851s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:56 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad 1G Sep 25 10:44:56 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:57 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad 1G" returned: 0 in 0.828s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:57 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad Sep 25 10:44:57 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:58 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad" returned: 0 in 0.681s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:58 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad is being set with open permissions: ugo+rw Sep 25 10:44:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:58 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad Sep 25 10:44:58 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:58 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad" returned: 0 in 0.514s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:58 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.info Sep 25 10:44:58 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:59 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.info" returned: 0 in 0.561s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:59 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.info is being set with open permissions: ugo+rw Sep 25 10:44:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:59 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.info Sep 25 10:44:59 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:59 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.info" returned: 0 in 0.503s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.155s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:59 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-f6395540-09a9-4f3e-be88-d3bb7dfb0b94 req-c0fdaac2-fa34-49b2-9a90-b45498e7f65c tempest-VolumesSnapshotsTestJSON-633239273 None] Create snapshot completed successfully Sep 25 10:45:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Acquiring lock "cinder-6ed3bb2e-ff3b-4d24-9473-763f06be8fad-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "cinder-6ed3bb2e-ff3b-4d24-9473-763f06be8fad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Acquiring lock "cinder-quobyte-9dee0ed1-a778-43bc-8f6c-38f84ab64842" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "cinder-quobyte-9dee0ed1-a778-43bc-8f6c-38f84ab64842" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Acquiring lock "cinder-quobyte-6ed3bb2e-ff3b-4d24-9473-763f06be8fad" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "cinder-quobyte-6ed3bb2e-ff3b-4d24-9473-763f06be8fad" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Deleting offline snapshot 6ed3bb2e-ff3b-4d24-9473-763f06be8fad of volume 9dee0ed1-a778-43bc-8f6c-38f84ab64842 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:45:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] snapshot_file for this snap is: volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:45:00 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[423c02c6-92af-47c1-95ca-0ed6eac84d0a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:45:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:01 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad Sep 25 10:45:01 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:01 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad" returned: 0 in 0.715s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:45:01 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8cdf77-0e0f-484d-a15b-32eeeeeb3881]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:45:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:01 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 Sep 25 10:45:01 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:02 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842" returned: 0 in 0.573s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:02 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad Sep 25 10:45:02 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:02 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad" returned: 0 in 0.544s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:02 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad Sep 25 10:45:02 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:03 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842.6ed3bb2e-ff3b-4d24-9473-763f06be8fad" returned: 0 in 0.434s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "cinder-quobyte-6ed3bb2e-ff3b-4d24-9473-763f06be8fad" released by "_delete_snapshot" :: held 2.479s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "cinder-quobyte-9dee0ed1-a778-43bc-8f6c-38f84ab64842" released by "delete_snapshot" :: held 2.517s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:03 devstack cinder-volume[86874]: DEBUG cinder.quota [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Created reservations ['1d184c8c-b9b1-4c42-9dee-6826c13a9477', '38474c15-49fd-4cb4-8a54-bfbe1dde9a62', 'c366e398-786b-481a-b633-923d7e8bb6f1', '417a3f71-73a0-4d93-b00f-7c030bc731cf'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:45:03 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Delete snapshot completed successfully. Sep 25 10:45:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-4c5650a4-a63a-485e-a2fc-f01d7f75f0d8 req-6353a234-1086-40d5-a77c-9df12c17b9f8 tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "cinder-6ed3bb2e-ff3b-4d24-9473-763f06be8fad-delete_snapshot" released by "delete_snapshot" :: held 2.823s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Acquiring lock "cinder-9dee0ed1-a778-43bc-8f6c-38f84ab64842-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "cinder-9dee0ed1-a778-43bc-8f6c-38f84ab64842-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Acquiring lock "cinder-quobyte-9dee0ed1-a778-43bc-8f6c-38f84ab64842" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "cinder-quobyte-9dee0ed1-a778-43bc-8f6c-38f84ab64842" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:04 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3564ffa2-3980-4f2c-9455-d424c983d14d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:45:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:04 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 Sep 25 10:45:04 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:05 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842" returned: 0 in 0.525s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:05 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842 Sep 25 10:45:05 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:05 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9dee0ed1-a778-43bc-8f6c-38f84ab64842" returned: 0 in 0.328s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "cinder-quobyte-9dee0ed1-a778-43bc-8f6c-38f84ab64842" released by "delete_volume" :: held 0.992s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:05 devstack cinder-volume[86874]: DEBUG cinder.quota [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Created reservations ['8b00ea6d-ba82-4a46-808f-cddcd5698c0d', 'ca0ca888-9cca-4a9f-9f04-4fe089fb70d1', 'd2d11937-de7e-4474-af1c-e15219486aee', 'a7e6c29e-6fd1-4e27-8392-93e089090166'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:45:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:05 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:05 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:05 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:45:05 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:06 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.425s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:06 devstack cinder-volume[86874]: DEBUG cinder.manager [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:45:06 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Deleted volume successfully. Sep 25 10:45:06 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-a04edc98-4d0c-4e58-8745-2018d8493c61 req-fc82a09f-e3a7-46e0-958d-8bc4c813c72a tempest-VolumesSnapshotsTestJSON-633239273 None] Lock "cinder-9dee0ed1-a778-43bc-8f6c-38f84ab64842-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Flow 'volume_create_manager' (956838f4-bad4-47b1-878c-85fecc28198f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b88ee63-05c0-4e77-95a6-99abba43f3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b88ee63-05c0-4e77-95a6-99abba43f3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1893288876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e49891-94a1-4ac3-ad43-04b9b98bac4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='805d85bcb94a4f3585be5a1cbb79fc5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:45:14Z,use_quota=True,user_id='5210c17663364ed3bb081290d0e0aff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3988135-90c1-4202-9ddc-b2222d99cf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3988135-90c1-4202-9ddc-b2222d99cf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67783b81-9ee4-4bc4-bd51-cbb4a7d3e741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67783b81-9ee4-4bc4-bd51-cbb4a7d3e741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e49891-94a1-4ac3-ad43-04b9b98bac4a', 'volume_name': 'volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43ffb4e-3978-47bf-afa0-83907a71581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43ffb4e-3978-47bf-afa0-83907a71581b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5e4a41-4afb-465b-9b4a-187caf0e5683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:14 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Volume 21e49891-94a1-4ac3-ad43-04b9b98bac4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a', 'volume_size': 1} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1893288876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e49891-94a1-4ac3-ad43-04b9b98bac4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='805d85bcb94a4f3585be5a1cbb79fc5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:45:14Z,use_quota=True,user_id='5210c17663364ed3bb081290d0e0aff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Creating volume 21e49891-94a1-4ac3-ad43-04b9b98bac4a {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:45:14 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:45:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:14 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a 1073741824 Sep 25 10:45:14 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:15 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a 1073741824" returned: 0 in 0.961s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:15 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a Sep 25 10:45:15 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:16 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a" returned: 0 in 0.570s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:45:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5e4a41-4afb-465b-9b4a-187caf0e5683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4809b5d0-09fa-41e3-bce8-63c44b4f13e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:16 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Volume volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a (21e49891-94a1-4ac3-ad43-04b9b98bac4a): created successfully Sep 25 10:45:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4809b5d0-09fa-41e3-bce8-63c44b4f13e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Flow 'volume_create_manager' (956838f4-bad4-47b1-878c-85fecc28198f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:45:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4cc81bd8-ee0c-4c36-baca-3839d44fe17f tempest-VolumesTestJSON-2021375262 None] Created volume successfully. Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Flow 'volume_create_manager' (c40f1143-9692-4b50-a7a0-474e975aaf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3c6235-eba1-4dd9-a0e0-dc4efaa942f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3c6235-eba1-4dd9-a0e0-dc4efaa942f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2091950206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3936323-a4d4-47d3-a636-f84922776220,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='805d85bcb94a4f3585be5a1cbb79fc5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:45:18Z,use_quota=True,user_id='5210c17663364ed3bb081290d0e0aff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e31cbb2-0ec4-443f-9b5d-3ac27f77f0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e31cbb2-0ec4-443f-9b5d-3ac27f77f0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9ed4d6-e772-4ad0-b180-58f20eb281b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9ed4d6-e772-4ad0-b180-58f20eb281b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3936323-a4d4-47d3-a636-f84922776220', 'volume_name': 'volume-a3936323-a4d4-47d3-a636-f84922776220', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e30ce7-1f89-4d52-81b5-e48763cc4c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e30ce7-1f89-4d52-81b5-e48763cc4c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0048f40b-7a84-456b-af0b-1b478388c6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:18 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Volume a3936323-a4d4-47d3-a636-f84922776220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3936323-a4d4-47d3-a636-f84922776220', 'volume_size': 1} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2091950206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3936323-a4d4-47d3-a636-f84922776220,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='805d85bcb94a4f3585be5a1cbb79fc5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:45:18Z,use_quota=True,user_id='5210c17663364ed3bb081290d0e0aff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Creating volume a3936323-a4d4-47d3-a636-f84922776220 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:45:18 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3936323-a4d4-47d3-a636-f84922776220 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:18 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3936323-a4d4-47d3-a636-f84922776220 1073741824 Sep 25 10:45:18 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:18 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3936323-a4d4-47d3-a636-f84922776220 1073741824" returned: 0 in 0.633s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3936323-a4d4-47d3-a636-f84922776220 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:19 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3936323-a4d4-47d3-a636-f84922776220 Sep 25 10:45:19 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:19 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3936323-a4d4-47d3-a636-f84922776220" returned: 0 in 0.442s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0048f40b-7a84-456b-af0b-1b478388c6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3936323-a4d4-47d3-a636-f84922776220', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36447d5c-478f-401f-9b38-cb074f859f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Flow 'volume_create_manager' (a6e12f57-31e9-4eee-806e-14eeea7993a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42055a70-d007-4f7a-83c4-a213e12889b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:19 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Volume volume-a3936323-a4d4-47d3-a636-f84922776220 (a3936323-a4d4-47d3-a636-f84922776220): created successfully Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36447d5c-478f-401f-9b38-cb074f859f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Flow 'volume_create_manager' (c40f1143-9692-4b50-a7a0-474e975aaf48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42055a70-d007-4f7a-83c4-a213e12889b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-287893795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4d9678-3c6e-41eb-9e11-87fdba8a21f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6560dc7103d744f48552e747b013daff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:45:19Z,use_quota=True,user_id='dbc868d1761c4271b94381577d8bc162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8766215c-270d-4d7e-ad24-49de18c93bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8766215c-270d-4d7e-ad24-49de18c93bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af50a106-2dec-48df-93ad-3f3ba09f9cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af50a106-2dec-48df-93ad-3f3ba09f9cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba4d9678-3c6e-41eb-9e11-87fdba8a21f0', 'volume_name': 'volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d479bf67-5b7b-4c10-9043-de5cf263d723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d479bf67-5b7b-4c10-9043-de5cf263d723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995d76e9-a76a-4ba9-b18a-ae37ab4b2304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:19 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Volume ba4d9678-3c6e-41eb-9e11-87fdba8a21f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0', 'volume_size': 1} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-287893795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4d9678-3c6e-41eb-9e11-87fdba8a21f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6560dc7103d744f48552e747b013daff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:45:19Z,use_quota=True,user_id='dbc868d1761c4271b94381577d8bc162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Creating volume ba4d9678-3c6e-41eb-9e11-87fdba8a21f0 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:45:19 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:45:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:19 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-27506b73-f1dc-47af-b7b6-f55aa2630131 tempest-VolumesTestJSON-2021375262 None] Created volume successfully. Sep 25 10:45:19 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0 1073741824 Sep 25 10:45:19 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:20 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:45:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Flow 'volume_create_manager' (602ae959-df3d-4d65-837f-c5decff6103e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:45:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a21a86eb-fc25-4f82-a539-8645b56eab10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a21a86eb-fc25-4f82-a539-8645b56eab10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-509960080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8571381c-a10a-4081-9075-948ca51c1d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6560dc7103d744f48552e747b013daff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:45:20Z,use_quota=True,user_id='dbc868d1761c4271b94381577d8bc162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd01ff4-5969-40fa-adc4-07e07fca4a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd01ff4-5969-40fa-adc4-07e07fca4a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6c5e35-84df-468d-9cf0-d23632633031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6c5e35-84df-468d-9cf0-d23632633031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8571381c-a10a-4081-9075-948ca51c1d88', 'volume_name': 'volume-8571381c-a10a-4081-9075-948ca51c1d88', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622488ce-11ba-466b-8c95-32c771fc1748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622488ce-11ba-466b-8c95-32c771fc1748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73dfcd2-33d3-4a22-a12b-bd178a402d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:20 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Volume 8571381c-a10a-4081-9075-948ca51c1d88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8571381c-a10a-4081-9075-948ca51c1d88', 'volume_size': 1} Sep 25 10:45:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:20 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0 1073741824" returned: 0 in 0.870s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:20 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0 Sep 25 10:45:20 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:21 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0" returned: 0 in 0.485s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.977s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-509960080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8571381c-a10a-4081-9075-948ca51c1d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6560dc7103d744f48552e747b013daff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:45:20Z,use_quota=True,user_id='dbc868d1761c4271b94381577d8bc162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Creating volume 8571381c-a10a-4081-9075-948ca51c1d88 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:45:21 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8571381c-a10a-4081-9075-948ca51c1d88 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995d76e9-a76a-4ba9-b18a-ae37ab4b2304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:21 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8571381c-a10a-4081-9075-948ca51c1d88 1073741824 Sep 25 10:45:21 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1113786d-147c-4658-9571-66a37857ee64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:21 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Volume volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0 (ba4d9678-3c6e-41eb-9e11-87fdba8a21f0): created successfully Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1113786d-147c-4658-9571-66a37857ee64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Flow 'volume_create_manager' (a6e12f57-31e9-4eee-806e-14eeea7993a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:45:21 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-fbeadd68-988d-49d5-8313-c0c13621a1d4 req-0a905ea6-c72b-4915-8cf1-ad86b26d9079 tempest-AttachVolumeNegativeTest-950702000 None] Terminate volume connection completed successfully. Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-fbeadd68-988d-49d5-8313-c0c13621a1d4 req-0a905ea6-c72b-4915-8cf1-ad86b26d9079 tempest-AttachVolumeNegativeTest-950702000 None] Deleting attachment a1f8e6c3-f056-4b90-8903-4c1bfc10b209. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:45:21 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-0b9e4b89-8394-4f75-b433-b51543a9cef1 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Created volume successfully. Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Flow 'volume_create_manager' (88d4e202-b35a-43e5-b078-d937776910a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c6d35e-92ad-4373-b502-ec6b25e39aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c6d35e-92ad-4373-b502-ec6b25e39aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1653093465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c184f17f-f640-476b-9fdd-2e2c62e48b20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='805d85bcb94a4f3585be5a1cbb79fc5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:45:21Z,use_quota=True,user_id='5210c17663364ed3bb081290d0e0aff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22a1f31-1270-45a4-8a81-b74e4d1e5aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22a1f31-1270-45a4-8a81-b74e4d1e5aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6fc63c-fb7b-462f-b4e9-63cc88d0e677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6fc63c-fb7b-462f-b4e9-63cc88d0e677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c184f17f-f640-476b-9fdd-2e2c62e48b20', 'volume_name': 'volume-c184f17f-f640-476b-9fdd-2e2c62e48b20', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1db508-87de-4cf0-82aa-3c28112039d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1db508-87de-4cf0-82aa-3c28112039d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e78ed4-487e-4785-b753-3f26a7b71e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:21 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Volume c184f17f-f640-476b-9fdd-2e2c62e48b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c184f17f-f640-476b-9fdd-2e2c62e48b20', 'volume_size': 1} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:21 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8571381c-a10a-4081-9075-948ca51c1d88 1073741824" returned: 0 in 0.753s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8571381c-a10a-4081-9075-948ca51c1d88 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:21 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8571381c-a10a-4081-9075-948ca51c1d88 Sep 25 10:45:21 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:22 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8571381c-a10a-4081-9075-948ca51c1d88" returned: 0 in 0.296s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.653s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1653093465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c184f17f-f640-476b-9fdd-2e2c62e48b20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='805d85bcb94a4f3585be5a1cbb79fc5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:45:21Z,use_quota=True,user_id='5210c17663364ed3bb081290d0e0aff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Creating volume c184f17f-f640-476b-9fdd-2e2c62e48b20 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:45:22 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c184f17f-f640-476b-9fdd-2e2c62e48b20 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73dfcd2-33d3-4a22-a12b-bd178a402d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8571381c-a10a-4081-9075-948ca51c1d88', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:22 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c184f17f-f640-476b-9fdd-2e2c62e48b20 1073741824 Sep 25 10:45:22 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c41b20-129e-4476-a916-905a1e00a6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:22 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Volume volume-8571381c-a10a-4081-9075-948ca51c1d88 (8571381c-a10a-4081-9075-948ca51c1d88): created successfully Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c41b20-129e-4476-a916-905a1e00a6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Flow 'volume_create_manager' (602ae959-df3d-4d65-837f-c5decff6103e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:45:22 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-558cc804-36db-4974-b4ea-f29ba77e6681 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Created volume successfully. Sep 25 10:45:22 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c184f17f-f640-476b-9fdd-2e2c62e48b20 1073741824" returned: 0 in 0.726s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c184f17f-f640-476b-9fdd-2e2c62e48b20 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:23 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c184f17f-f640-476b-9fdd-2e2c62e48b20 Sep 25 10:45:23 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:23 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c184f17f-f640-476b-9fdd-2e2c62e48b20" returned: 0 in 0.402s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:45:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e78ed4-487e-4785-b753-3f26a7b71e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c184f17f-f640-476b-9fdd-2e2c62e48b20', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c1c58b-5c4b-48e2-829d-0ed7a21eeb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:23 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Volume volume-c184f17f-f640-476b-9fdd-2e2c62e48b20 (c184f17f-f640-476b-9fdd-2e2c62e48b20): created successfully Sep 25 10:45:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c1c58b-5c4b-48e2-829d-0ed7a21eeb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Flow 'volume_create_manager' (88d4e202-b35a-43e5-b078-d937776910a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:45:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ce718a95-0c19-4248-9c2b-30a7649a717a tempest-VolumesTestJSON-2021375262 None] Created volume successfully. Sep 25 10:45:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:45:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:26 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:45:26 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:26 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.591s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:45:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:45:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:45:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:45:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Acquiring lock "cinder-c184f17f-f640-476b-9fdd-2e2c62e48b20-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Lock "cinder-c184f17f-f640-476b-9fdd-2e2c62e48b20-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Acquiring lock "cinder-quobyte-c184f17f-f640-476b-9fdd-2e2c62e48b20" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Lock "cinder-quobyte-c184f17f-f640-476b-9fdd-2e2c62e48b20" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:27 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fc1c2c-ae32-44a5-a9ef-ad8fd0bc9f0e]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:45:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c184f17f-f640-476b-9fdd-2e2c62e48b20 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:27 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c184f17f-f640-476b-9fdd-2e2c62e48b20 Sep 25 10:45:27 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:28 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c184f17f-f640-476b-9fdd-2e2c62e48b20" returned: 0 in 0.765s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c184f17f-f640-476b-9fdd-2e2c62e48b20 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:28 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c184f17f-f640-476b-9fdd-2e2c62e48b20 Sep 25 10:45:28 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:29 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c184f17f-f640-476b-9fdd-2e2c62e48b20" returned: 0 in 0.707s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Lock "cinder-quobyte-c184f17f-f640-476b-9fdd-2e2c62e48b20" released by "delete_volume" :: held 1.595s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:29 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-9f9d37a4-5fd6-4f40-a98f-2cfcf6aab65f req-27b64343-a024-4d3c-8601-d3c74b20cfb8 tempest-AttachVolumeTestJSON-1139818827 None] Terminate volume connection completed successfully. Sep 25 10:45:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-9f9d37a4-5fd6-4f40-a98f-2cfcf6aab65f req-27b64343-a024-4d3c-8601-d3c74b20cfb8 tempest-AttachVolumeTestJSON-1139818827 None] Deleting attachment 03a5d9bb-cc51-4544-aaa4-0a6a81af35e6. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:45:29 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Created reservations ['e9ea0d2a-0e45-414e-8556-2ccaa806446b', '3c98667b-da92-4b1d-a6fa-d9ed3d81eb52', '07c9effe-6352-410d-a346-800947a254aa', '1b9aa6d1-796e-4010-bc6d-0eacb938173e'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:45:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:29 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:45:29 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Acquiring lock "cinder-a3936323-a4d4-47d3-a636-f84922776220-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Lock "cinder-a3936323-a4d4-47d3-a636-f84922776220-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Acquiring lock "cinder-quobyte-a3936323-a4d4-47d3-a636-f84922776220" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:30 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.721s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:30 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:45:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Lock "cinder-quobyte-a3936323-a4d4-47d3-a636-f84922776220" acquired by "delete_volume" :: waited 0.049s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:30 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Deleted volume successfully. Sep 25 10:45:30 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8046a58c-3e72-47e9-8a79-dfdabecc3a82]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:45:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3936323-a4d4-47d3-a636-f84922776220 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5533c295-0dc8-4005-97b9-9daeebc09c73 tempest-VolumesTestJSON-2021375262 None] Lock "cinder-c184f17f-f640-476b-9fdd-2e2c62e48b20-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:30 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3936323-a4d4-47d3-a636-f84922776220 Sep 25 10:45:30 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:31 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3936323-a4d4-47d3-a636-f84922776220" returned: 0 in 0.914s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3936323-a4d4-47d3-a636-f84922776220 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:31 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3936323-a4d4-47d3-a636-f84922776220 Sep 25 10:45:31 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:31 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3936323-a4d4-47d3-a636-f84922776220" returned: 0 in 0.524s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Lock "cinder-quobyte-a3936323-a4d4-47d3-a636-f84922776220" released by "delete_volume" :: held 1.555s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:31 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Created reservations ['00e9f32d-9c40-4397-beba-ef9da27052a8', 'a0a9dae6-beb6-4709-84d3-c6fc001c1ad8', 'c56de477-e121-4cd1-8053-20d06972be02', 'cc36c5ad-7d45-42ab-b167-8b4a56957d30'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:45:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:32 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:45:32 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:32 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Acquiring lock "cinder-21e49891-94a1-4ac3-ad43-04b9b98bac4a-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.403s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:32 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:45:32 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Deleted volume successfully. Sep 25 10:45:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Lock "cinder-21e49891-94a1-4ac3-ad43-04b9b98bac4a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-70a17c8b-d667-4319-b6b5-4b17e8b972f6 tempest-VolumesTestJSON-2021375262 None] Lock "cinder-a3936323-a4d4-47d3-a636-f84922776220-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Acquiring lock "cinder-quobyte-21e49891-94a1-4ac3-ad43-04b9b98bac4a" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Lock "cinder-quobyte-21e49891-94a1-4ac3-ad43-04b9b98bac4a" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:32 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05626f0-1b6f-4a4f-8d2a-93261fa1d701]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:45:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:32 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a Sep 25 10:45:32 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:33 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a" returned: 0 in 0.513s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:33 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a Sep 25 10:45:33 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:33 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-21e49891-94a1-4ac3-ad43-04b9b98bac4a" returned: 0 in 0.418s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Lock "cinder-quobyte-21e49891-94a1-4ac3-ad43-04b9b98bac4a" released by "delete_volume" :: held 1.040s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:33 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Created reservations ['6cfb6925-aa4b-4006-bad0-7dbc512389ae', '7fa39c5e-63c4-4286-9916-175f4b395477', '7997c69f-2c50-4c7b-8b15-b945c7ee545b', '9e41c710-4d25-44b7-94e7-6c0c26139177'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:45:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:33 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:45:33 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:34 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.307s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:34 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:45:34 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Deleted volume successfully. Sep 25 10:45:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3d631cfc-4dc8-41e0-b654-780dc4801b8f tempest-VolumesTestJSON-2021375262 None] Lock "cinder-21e49891-94a1-4ac3-ad43-04b9b98bac4a-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:44 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=59,cinder:SELECT=46,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:45:48 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=58,cinder:UPDATE=65,cinder:DELETE=8,cinder:INSERT=12 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:45:49 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a4ac3785-2514-49d7-ae4c-ea1bd6575c5c tempest-GroupSnapshotsTest-1292036940 None] Group tempest-GroupSnapshotsTest-Group-1102891703: creating Sep 25 10:45:49 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a4ac3785-2514-49d7-ae4c-ea1bd6575c5c tempest-GroupSnapshotsTest-1292036940 None] Group tempest-GroupSnapshotsTest-Group-1102891703: created successfully Sep 25 10:45:49 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a4ac3785-2514-49d7-ae4c-ea1bd6575c5c tempest-GroupSnapshotsTest-1292036940 None] Create group completed successfully. Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Flow 'volume_create_manager' (2bffef9a-5d6d-4a25-8c17-90fa49d2fb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a11b5fd-fcd8-4346-8a3a-eb704c76d453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a11b5fd-fcd8-4346-8a3a-eb704c76d453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-572150284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=beb57320-de5d-419e-acc1-bf5fc348c8a1,host='devstack@QuobyteHD#QuobyteHD',id=fbd55a73-095e-40eb-88bc-b056347169c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394959bb2ebf4f6da4088b76d707a9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:45:53Z,use_quota=True,user_id='aca4589e02734d0cb63ab52ec7a7f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c02a876-91d3-448f-a78d-efe2728d6288),volume_type_id=7c02a876-91d3-448f-a78d-efe2728d6288)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01539a5-0318-4820-993c-3b8c5ecc571f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01539a5-0318-4820-993c-3b8c5ecc571f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040497ba-7964-4139-b5d2-6b66596c6690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040497ba-7964-4139-b5d2-6b66596c6690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbd55a73-095e-40eb-88bc-b056347169c6', 'volume_name': 'volume-fbd55a73-095e-40eb-88bc-b056347169c6', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da984f4-b68b-4670-97e4-e9e5632349a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da984f4-b68b-4670-97e4-e9e5632349a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a13812-cc65-45bf-a291-ac751ad2c890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:53 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Volume fbd55a73-095e-40eb-88bc-b056347169c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbd55a73-095e-40eb-88bc-b056347169c6', 'volume_size': 1} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=beb57320-de5d-419e-acc1-bf5fc348c8a1,created_at=2026-09-25T08:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-572150284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=beb57320-de5d-419e-acc1-bf5fc348c8a1,host='devstack@QuobyteHD#QuobyteHD',id=fbd55a73-095e-40eb-88bc-b056347169c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394959bb2ebf4f6da4088b76d707a9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:45:53Z,use_quota=True,user_id='aca4589e02734d0cb63ab52ec7a7f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c02a876-91d3-448f-a78d-efe2728d6288),volume_type_id=7c02a876-91d3-448f-a78d-efe2728d6288)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Creating volume fbd55a73-095e-40eb-88bc-b056347169c6 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:45:53 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:45:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:53 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 1073741824 Sep 25 10:45:53 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:54 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 1073741824" returned: 0 in 0.739s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:54 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 Sep 25 10:45:54 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:55 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6" returned: 0 in 0.567s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:45:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a13812-cc65-45bf-a291-ac751ad2c890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd55a73-095e-40eb-88bc-b056347169c6', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf252019-78a1-40ec-83e5-9c80a1168cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:55 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Volume volume-fbd55a73-095e-40eb-88bc-b056347169c6 (fbd55a73-095e-40eb-88bc-b056347169c6): created successfully Sep 25 10:45:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf252019-78a1-40ec-83e5-9c80a1168cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Flow 'volume_create_manager' (2bffef9a-5d6d-4a25-8c17-90fa49d2fb98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:45:55 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2f209dc8-c403-42c2-99a8-ccec868e723e tempest-GroupSnapshotsTest-1292036940 None] Created volume successfully. Sep 25 10:45:56 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] GroupSnapshot 929c54ba-31a8-4e38-b2fd-b6031f74d7c0: creating. Sep 25 10:45:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] Group snapshot 929c54ba-31a8-4e38-b2fd-b6031f74d7c0: creating. {{(pid=86874) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 10:45:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] Creating offline snapshot 2d19003b-0d23-4b78-97f6-6d9f21640be6 of volume fbd55a73-095e-40eb-88bc-b056347169c6 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:45:56 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c750ba-484b-475b-b883-f7946ba7870f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:45:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:56 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 Sep 25 10:45:56 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:57 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6" returned: 0 in 0.546s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:57 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 1G Sep 25 10:45:57 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:57 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 1G" returned: 0 in 0.597s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd55a73-095e-40eb-88bc-b056347169c6 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:57 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd55a73-095e-40eb-88bc-b056347169c6 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 Sep 25 10:45:57 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:58 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd55a73-095e-40eb-88bc-b056347169c6 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6" returned: 0 in 0.558s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:58 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:45:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:58 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 Sep 25 10:45:58 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:58 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6" returned: 0 in 0.437s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:58 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.info Sep 25 10:45:58 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:59 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.info" returned: 0 in 0.363s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:59 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:45:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:59 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.info Sep 25 10:45:59 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:59 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.info" returned: 0 in 0.277s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.918s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:59 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bc6edca1-5f4c-4c3b-b019-c1683f94033d tempest-GroupSnapshotsTest-1292036940 None] group_snapshot 929c54ba-31a8-4e38-b2fd-b6031f74d7c0: created successfully Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-2d19003b-0d23-4b78-97f6-6d9f21640be6-19bf0958-4803-4b4c-89a4-ab880150df75" by "_create_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-2d19003b-0d23-4b78-97f6-6d9f21640be6-19bf0958-4803-4b4c-89a4-ab880150df75" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Creating volume 19bf0958-4803-4b4c-89a4-ab880150df75 from snapshot 2d19003b-0d23-4b78-97f6-6d9f21640be6 {{(pid=86874) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-19bf0958-4803-4b4c-89a4-ab880150df75" by "_copy_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-19bf0958-4803-4b4c-89a4-ab880150df75" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] snapshot: 2d19003b-0d23-4b78-97f6-6d9f21640be6, volume: 19bf0958-4803-4b4c-89a4-ab880150df75, {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[121df256-230e-4aae-afb7-6b5286d2a260]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:00 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 Sep 25 10:46:00 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:01 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6" returned: 0 in 0.395s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbd55a73-095e-40eb-88bc-b056347169c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:46:01 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[872f1804-6492-4f07-87b8-f1bde474b81d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:01 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 Sep 25 10:46:01 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:01 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6" returned: 0 in 0.412s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] will copy from snapshot at /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:46:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Creating direct copy from snapshot {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:46:01 devstack cinder-volume[86874]: DEBUG cinder.utils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Path /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75 not found in is_blk_device check {{(pid=86874) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 10:46:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:01 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75 Sep 25 10:46:01 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-84fefa73-a9c8-411c-8b50-c8757bed03ac req-19cd44ff-6d42-4363-8f70-e34b6775cbd7 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:10 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:46:12 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75" returned: 0 in 10.889s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:12 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6, size 1024.00 MB, duration 10.89 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:46:12 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Converted 1024.00 MB image at 94.03 MB/s Sep 25 10:46:12 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:46:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:12 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75 Sep 25 10:46:12 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:12 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75" returned: 0 in 0.301s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-19bf0958-4803-4b4c-89a4-ab880150df75" released by "_copy_volume_from_snapshot" :: held 12.091s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-2d19003b-0d23-4b78-97f6-6d9f21640be6-19bf0958-4803-4b4c-89a4-ab880150df75" released by "_create_volume_from_snapshot" :: held 12.184s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.212s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-84fefa73-a9c8-411c-8b50-c8757bed03ac req-19cd44ff-6d42-4363-8f70-e34b6775cbd7 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.310s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-84fefa73-a9c8-411c-8b50-c8757bed03ac req-19cd44ff-6d42-4363-8f70-e34b6775cbd7 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-84fefa73-a9c8-411c-8b50-c8757bed03ac req-19cd44ff-6d42-4363-8f70-e34b6775cbd7 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3db528a5-7e6c-415b-a18e-78611020513a', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:46:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-26518ccf-2416-4617-95a9-80c633b1d1b4 tempest-GroupSnapshotsTest-1292036940 None] Create group from source-snapshot-929c54ba-31a8-4e38-b2fd-b6031f74d7c0 completed successfully. Sep 25 10:46:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-84fefa73-a9c8-411c-8b50-c8757bed03ac req-19cd44ff-6d42-4363-8f70-e34b6775cbd7 tempest-TestServerVolumeAttachmentScenario-1662852952 None] attachment_update completed successfully. Sep 25 10:46:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-19bf0958-4803-4b4c-89a4-ab880150df75" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-19bf0958-4803-4b4c-89a4-ab880150df75" acquired by "delete_volume" :: waited 0.045s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:14 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bcc0ad-9ad8-4705-8777-77a820958e69]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:14 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75 Sep 25 10:46:14 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:15 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75" returned: 0 in 0.623s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:15 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75 Sep 25 10:46:15 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:15 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19bf0958-4803-4b4c-89a4-ab880150df75" returned: 0 in 0.398s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-19bf0958-4803-4b4c-89a4-ab880150df75" released by "delete_volume" :: held 1.118s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:15 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Created reservations ['7f863e2f-6730-499c-a214-91f1a7c8396e'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:15 devstack cinder-volume[86874]: WARNING cinder.quota [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1813893322 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1813893322, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:46:15 devstack cinder-volume[86874]: WARNING cinder.quota [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1813893322 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1813893322, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:46:15 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Created reservations ['e21d6c9e-1791-4e4e-b841-cf6114865267', 'c132048c-80db-4e2e-93ff-7ab65ee91bba', 'bc3ce790-dfd4-4d7e-953b-16fdced6bf9b', '7e757c77-827c-477b-bed4-caf271962e24'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:16 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:46:16 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:16 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.439s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:16 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:46:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4e94f98d-dfd7-4882-abbe-042ecc5542c1 tempest-GroupSnapshotsTest-1292036940 None] Delete group completed successfully. Sep 25 10:46:17 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] group_snapshot 929c54ba-31a8-4e38-b2fd-b6031f74d7c0: deleting Sep 25 10:46:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] group_snapshot 929c54ba-31a8-4e38-b2fd-b6031f74d7c0: deleting {{(pid=86874) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 10:46:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-fbd55a73-095e-40eb-88bc-b056347169c6" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-fbd55a73-095e-40eb-88bc-b056347169c6" acquired by "delete_snapshot" :: waited 0.071s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-2d19003b-0d23-4b78-97f6-6d9f21640be6" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-2d19003b-0d23-4b78-97f6-6d9f21640be6" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] Deleting offline snapshot 2d19003b-0d23-4b78-97f6-6d9f21640be6 of volume fbd55a73-095e-40eb-88bc-b056347169c6 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:46:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] snapshot_file for this snap is: volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:46:18 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57c146e-0b33-441b-a787-2d7bb222ce00]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:18 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 Sep 25 10:46:18 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:18 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6" returned: 0 in 0.517s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbd55a73-095e-40eb-88bc-b056347169c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:46:18 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b07b691-1d5e-4c99-a530-2ffd1faa4bcf]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:18 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 Sep 25 10:46:18 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:19 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6" returned: 0 in 0.852s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:19 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 Sep 25 10:46:19 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-f90a138d-f453-472d-9787-c792c5baf275 req-4590454c-d26b-4b7d-94e7-16fd6091f82f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-f90a138d-f453-472d-9787-c792c5baf275 req-4590454c-d26b-4b7d-94e7-16fd6091f82f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-f90a138d-f453-472d-9787-c792c5baf275 req-4590454c-d26b-4b7d-94e7-16fd6091f82f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-f90a138d-f453-472d-9787-c792c5baf275 req-4590454c-d26b-4b7d-94e7-16fd6091f82f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-8571381c-a10a-4081-9075-948ca51c1d88', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '454575d7-0520-4bc3-b4da-ebd08973080c', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:46:20 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6" returned: 0 in 0.496s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:20 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6 Sep 25 10:46:20 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:20 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-f90a138d-f453-472d-9787-c792c5baf275 req-4590454c-d26b-4b7d-94e7-16fd6091f82f tempest-TestServerVolumeAttachmentScenario-1662852952 None] attachment_update completed successfully. Sep 25 10:46:20 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6.2d19003b-0d23-4b78-97f6-6d9f21640be6" returned: 0 in 0.440s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-2d19003b-0d23-4b78-97f6-6d9f21640be6" released by "_delete_snapshot" :: held 2.557s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-fbd55a73-095e-40eb-88bc-b056347169c6" released by "delete_snapshot" :: held 2.634s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:20 devstack cinder-volume[86874]: WARNING cinder.quota [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1813893322 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1813893322, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:46:20 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] Created reservations ['4b0023b6-f391-4019-8cb5-1c90bc0236cc', '203f5c83-84c1-4a0b-9c86-7d15cddfb519', '7c93428c-729c-452a-9863-a32278ac0f75', '8da43c96-f03d-4a0a-91ef-877903e512c3'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:20 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-e5b4886d-fd09-421f-aef2-714876e52356 tempest-GroupSnapshotsTest-1292036940 None] group_snapshot 929c54ba-31a8-4e38-b2fd-b6031f74d7c0: deleted successfully Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Flow 'volume_create_manager' (d5a17c37-2336-48f1-af4b-a2a4cd705b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f64451-46e1-4311-ae23-55c1e6a4476a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f64451-46e1-4311-ae23-55c1e6a4476a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1178622419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdafc901-d451-4413-b760-78af3cbf78dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5007e87c0a54a34a4fa34d76dd8ea2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:21Z,use_quota=True,user_id='4fd1ace02e3e46a09d32d07e1be07550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d2dcc7-5723-492b-a430-6c0c18fd4cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d2dcc7-5723-492b-a430-6c0c18fd4cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171d781d-ef64-44ce-bcd6-7376c486a31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171d781d-ef64-44ce-bcd6-7376c486a31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdafc901-d451-4413-b760-78af3cbf78dc', 'volume_name': 'volume-fdafc901-d451-4413-b760-78af3cbf78dc', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda4ed37-fe21-4b68-ba19-bb53c400df16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda4ed37-fe21-4b68-ba19-bb53c400df16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f0ac84-04b7-4192-b1d8-c998d3b17a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:21 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Volume fdafc901-d451-4413-b760-78af3cbf78dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdafc901-d451-4413-b760-78af3cbf78dc', 'volume_size': 1} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1178622419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdafc901-d451-4413-b760-78af3cbf78dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5007e87c0a54a34a4fa34d76dd8ea2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:21Z,use_quota=True,user_id='4fd1ace02e3e46a09d32d07e1be07550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Creating volume fdafc901-d451-4413-b760-78af3cbf78dc {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:21 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fdafc901-d451-4413-b760-78af3cbf78dc 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:21 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fdafc901-d451-4413-b760-78af3cbf78dc 1073741824 Sep 25 10:46:21 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-fbd55a73-095e-40eb-88bc-b056347169c6" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-fbd55a73-095e-40eb-88bc-b056347169c6" acquired by "delete_volume" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d486d143-c307-4410-b93d-4c18eb3d445a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:21 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 Sep 25 10:46:21 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:22 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6" returned: 0 in 0.601s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:22 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6 Sep 25 10:46:22 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:22 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fdafc901-d451-4413-b760-78af3cbf78dc 1073741824" returned: 0 in 0.794s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fdafc901-d451-4413-b760-78af3cbf78dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:22 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fdafc901-d451-4413-b760-78af3cbf78dc Sep 25 10:46:22 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:22 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fbd55a73-095e-40eb-88bc-b056347169c6" returned: 0 in 0.450s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-fbd55a73-095e-40eb-88bc-b056347169c6" released by "delete_volume" :: held 1.156s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:22 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fdafc901-d451-4413-b760-78af3cbf78dc" returned: 0 in 0.448s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:46:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f0ac84-04b7-4192-b1d8-c998d3b17a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdafc901-d451-4413-b760-78af3cbf78dc', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e20db3-510e-41ca-8ed3-2e9b58f78314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:23 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Created reservations ['c2ee20d5-24b0-4916-b173-3062d2f0caed'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:23 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Volume volume-fdafc901-d451-4413-b760-78af3cbf78dc (fdafc901-d451-4413-b760-78af3cbf78dc): created successfully Sep 25 10:46:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e20db3-510e-41ca-8ed3-2e9b58f78314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Flow 'volume_create_manager' (d5a17c37-2336-48f1-af4b-a2a4cd705b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-27936a2d-f347-4b72-9d7d-b1c76c92f450 tempest-AttachVolumeNegativeTest-950702000 None] Created volume successfully. Sep 25 10:46:23 devstack cinder-volume[86874]: WARNING cinder.db.api [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1813893322'] Sep 25 10:46:23 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Created reservations ['31fd7f01-6097-4320-8d93-a4c8f1aa9f26', '9ebaa047-0f1e-4cbe-8730-f3b2d5dd29f3', '5d6e3f2e-15ab-411f-bac2-dfcce52b3cd6', 'f9002b2b-9aec-45e1-beb2-a1f7d390ae37'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:23 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:46:23 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-6f9712b4-8640-4fd2-8fe2-956bceee7b62 req-8d4998a7-dd01-4f4c-8242-397fa9e8b61f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Terminate volume connection completed successfully. Sep 25 10:46:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-6f9712b4-8640-4fd2-8fe2-956bceee7b62 req-8d4998a7-dd01-4f4c-8242-397fa9e8b61f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Deleting attachment 454575d7-0520-4bc3-b4da-ebd08973080c. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:46:23 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.473s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:23 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:46:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-affcb020-af7e-41b0-ad61-65a6b4d4a7c7 tempest-GroupSnapshotsTest-1292036940 None] Delete group completed successfully. Sep 25 10:46:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-f6ac8951-3066-4212-981d-4ea6941cae3f req-9f05f5b2-c667-4fc2-9444-1eefb94334bc tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-f6ac8951-3066-4212-981d-4ea6941cae3f req-9f05f5b2-c667-4fc2-9444-1eefb94334bc tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-f6ac8951-3066-4212-981d-4ea6941cae3f req-9f05f5b2-c667-4fc2-9444-1eefb94334bc tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-f6ac8951-3066-4212-981d-4ea6941cae3f req-9f05f5b2-c667-4fc2-9444-1eefb94334bc tempest-AttachVolumeNegativeTest-950702000 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-fdafc901-d451-4413-b760-78af3cbf78dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89d144e4-8bf0-4170-bae4-169d99917c4b', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:46:25 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-f6ac8951-3066-4212-981d-4ea6941cae3f req-9f05f5b2-c667-4fc2-9444-1eefb94334bc tempest-AttachVolumeNegativeTest-950702000 None] attachment_update completed successfully. Sep 25 10:46:25 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-06f836df-294f-406a-bd74-ea78346f3892 tempest-GroupSnapshotsTest-1292036940 None] Group tempest-GroupSnapshotsTest-Group-1542982469: creating Sep 25 10:46:25 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-06f836df-294f-406a-bd74-ea78346f3892 tempest-GroupSnapshotsTest-1292036940 None] Group tempest-GroupSnapshotsTest-Group-1542982469: created successfully Sep 25 10:46:25 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-06f836df-294f-406a-bd74-ea78346f3892 tempest-GroupSnapshotsTest-1292036940 None] Create group completed successfully. Sep 25 10:46:25 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-56490920-bdf0-4b6b-852e-fbf89d636fc9 req-b7a7ecba-40ea-4412-9b51-feca9b5dfba2 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Terminate volume connection completed successfully. Sep 25 10:46:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-56490920-bdf0-4b6b-852e-fbf89d636fc9 req-b7a7ecba-40ea-4412-9b51-feca9b5dfba2 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Deleting attachment 3db528a5-7e6c-415b-a18e-78611020513a. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:46:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:46:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:26 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:46:26 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:26 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.422s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:46:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:46:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:46:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Flow 'volume_create_manager' (2ddd35c7-2e90-4657-9e1c-5c0652e60947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9010c67-83e7-4fc5-8f3e-f09106a1bdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9010c67-83e7-4fc5-8f3e-f09106a1bdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1001384867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13b1dadc-73cb-454f-895f-14cd3ca7cffa,host='devstack@QuobyteHD#QuobyteHD',id=9fcaadb5-e71f-49b3-b9cd-8da57c2cf121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394959bb2ebf4f6da4088b76d707a9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:28Z,use_quota=True,user_id='aca4589e02734d0cb63ab52ec7a7f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67b25abb-ac5c-4377-9e88-f52fcff1a4d3),volume_type_id=67b25abb-ac5c-4377-9e88-f52fcff1a4d3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6621590a-0253-4761-a666-f578fec514f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6621590a-0253-4761-a666-f578fec514f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f36ae68-f0e9-4ca4-9606-39a74dcbab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f36ae68-f0e9-4ca4-9606-39a74dcbab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fcaadb5-e71f-49b3-b9cd-8da57c2cf121', 'volume_name': 'volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4fb976-b0dc-462e-8f48-3181cd1d57f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4fb976-b0dc-462e-8f48-3181cd1d57f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe6bb12-a933-40bb-9aaf-bd89f8435eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:28 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Volume 9fcaadb5-e71f-49b3-b9cd-8da57c2cf121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121', 'volume_size': 1} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=13b1dadc-73cb-454f-895f-14cd3ca7cffa,created_at=2026-09-25T08:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1001384867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13b1dadc-73cb-454f-895f-14cd3ca7cffa,host='devstack@QuobyteHD#QuobyteHD',id=9fcaadb5-e71f-49b3-b9cd-8da57c2cf121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394959bb2ebf4f6da4088b76d707a9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:28Z,use_quota=True,user_id='aca4589e02734d0cb63ab52ec7a7f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67b25abb-ac5c-4377-9e88-f52fcff1a4d3),volume_type_id=67b25abb-ac5c-4377-9e88-f52fcff1a4d3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Creating volume 9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:28 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:46:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:28 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 1073741824 Sep 25 10:46:28 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:29 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-668025ce-dd54-4e5e-ae7e-cb2179208fb3 req-3971d8f1-6dff-4504-be3d-6a23b22d9f82 tempest-AttachVolumeNegativeTest-950702000 None] Terminate volume connection completed successfully. Sep 25 10:46:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-668025ce-dd54-4e5e-ae7e-cb2179208fb3 req-3971d8f1-6dff-4504-be3d-6a23b22d9f82 tempest-AttachVolumeNegativeTest-950702000 None] Deleting attachment 89d144e4-8bf0-4170-bae4-169d99917c4b. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:46:29 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 1073741824" returned: 0 in 1.382s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:29 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 Sep 25 10:46:29 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121" returned: 0 in 0.584s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:46:30 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:30 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe6bb12-a933-40bb-9aaf-bd89f8435eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:30 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40230070-d8ca-4f0f-a3b9-d1846cedd607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:30 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Volume volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 (9fcaadb5-e71f-49b3-b9cd-8da57c2cf121): created successfully Sep 25 10:46:30 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40230070-d8ca-4f0f-a3b9-d1846cedd607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:30 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Flow 'volume_create_manager' (2ddd35c7-2e90-4657-9e1c-5c0652e60947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:30 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-699a0958-ded2-4819-9795-1bb67940deda tempest-GroupSnapshotsTest-1292036940 None] Created volume successfully. Sep 25 10:46:31 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Flow 'volume_create_manager' (69407820-7b52-4552-a21f-a2824c649a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6617e8b7-36d5-4fc4-8ea7-7ba12b3326bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6617e8b7-36d5-4fc4-8ea7-7ba12b3326bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-778595033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13b1dadc-73cb-454f-895f-14cd3ca7cffa,host='devstack@QuobyteHD#QuobyteHD',id=064197a1-f93a-4b58-b7cd-fd2eb00c796d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394959bb2ebf4f6da4088b76d707a9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:32Z,use_quota=True,user_id='aca4589e02734d0cb63ab52ec7a7f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67b25abb-ac5c-4377-9e88-f52fcff1a4d3),volume_type_id=67b25abb-ac5c-4377-9e88-f52fcff1a4d3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66eab27-20ad-427d-8721-2129796dc984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66eab27-20ad-427d-8721-2129796dc984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c067a768-6200-42c6-b89c-2e7910a45259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c067a768-6200-42c6-b89c-2e7910a45259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '064197a1-f93a-4b58-b7cd-fd2eb00c796d', 'volume_name': 'volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4784386-3374-4236-9858-23970bb7e1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4784386-3374-4236-9858-23970bb7e1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59af3476-4e9c-406d-a2b4-3ccf9e77e6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:32 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Volume 064197a1-f93a-4b58-b7cd-fd2eb00c796d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d', 'volume_size': 1} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=13b1dadc-73cb-454f-895f-14cd3ca7cffa,created_at=2026-09-25T08:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-778595033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13b1dadc-73cb-454f-895f-14cd3ca7cffa,host='devstack@QuobyteHD#QuobyteHD',id=064197a1-f93a-4b58-b7cd-fd2eb00c796d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394959bb2ebf4f6da4088b76d707a9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:32Z,use_quota=True,user_id='aca4589e02734d0cb63ab52ec7a7f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67b25abb-ac5c-4377-9e88-f52fcff1a4d3),volume_type_id=67b25abb-ac5c-4377-9e88-f52fcff1a4d3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Creating volume 064197a1-f93a-4b58-b7cd-fd2eb00c796d {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:32 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:46:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:32 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d 1073741824 Sep 25 10:46:32 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:33 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d 1073741824" returned: 0 in 1.086s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:33 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d Sep 25 10:46:33 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:33 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d" returned: 0 in 0.453s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:46:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59af3476-4e9c-406d-a2b4-3ccf9e77e6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58e80d4-d127-4c39-89f2-39bfc5d5cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:34 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Volume volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d (064197a1-f93a-4b58-b7cd-fd2eb00c796d): created successfully Sep 25 10:46:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58e80d4-d127-4c39-89f2-39bfc5d5cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Flow 'volume_create_manager' (69407820-7b52-4552-a21f-a2824c649a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:34 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-aa87919d-1d96-4518-8396-3315862a7070 tempest-GroupSnapshotsTest-1292036940 None] Created volume successfully. Sep 25 10:46:35 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-dad20fac-4a94-4c82-b43a-4d7d02e0e81c tempest-GroupSnapshotsTest-1292036940 None] Update group completed successfully. Sep 25 10:46:36 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-e19c9fea-e680-4d11-98e8-f15729fa88ec tempest-GroupSnapshotsTest-1292036940 None] Update group completed successfully. Sep 25 10:46:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Acquiring lock "cinder-8571381c-a10a-4081-9075-948ca51c1d88-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "cinder-8571381c-a10a-4081-9075-948ca51c1d88-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Acquiring lock "cinder-quobyte-8571381c-a10a-4081-9075-948ca51c1d88" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "cinder-quobyte-8571381c-a10a-4081-9075-948ca51c1d88" acquired by "delete_volume" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:37 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b32cab7-0a44-4432-8245-becc0b509061]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8571381c-a10a-4081-9075-948ca51c1d88 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:37 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8571381c-a10a-4081-9075-948ca51c1d88 Sep 25 10:46:37 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:38 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-77db0ef3-d350-48af-a4de-523c26406419 tempest-GroupSnapshotsTest-1292036940 None] Update group completed successfully. Sep 25 10:46:38 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8571381c-a10a-4081-9075-948ca51c1d88" returned: 0 in 0.753s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8571381c-a10a-4081-9075-948ca51c1d88 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:38 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8571381c-a10a-4081-9075-948ca51c1d88 Sep 25 10:46:38 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:38 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8571381c-a10a-4081-9075-948ca51c1d88" returned: 0 in 0.389s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "cinder-quobyte-8571381c-a10a-4081-9075-948ca51c1d88" released by "delete_volume" :: held 1.231s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:39 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Created reservations ['d6a3d947-897b-49c3-b6e4-e52bd1a2fa4c', 'b0db2966-58bf-4866-9ae4-754cc031d935', 'ea823271-4a17-4b50-906f-7d9a39b269c9', 'aa6550d2-09f1-4977-8982-3b36c2c2a413'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:39 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:46:39 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:39 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.394s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:39 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:46:39 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Deleted volume successfully. Sep 25 10:46:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-81df5826-6c38-44d9-bec1-312f129d9853 tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "cinder-8571381c-a10a-4081-9075-948ca51c1d88-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:39 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-cd710205-3acd-4226-aa16-711a5bb7b648 tempest-GroupSnapshotsTest-1292036940 None] Update group completed successfully. Sep 25 10:46:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Acquiring lock "cinder-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "cinder-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Acquiring lock "cinder-quobyte-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "cinder-quobyte-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0" acquired by "delete_volume" :: waited 0.037s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:40 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51098d3-f300-4623-acd1-a9c1248a0956]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:40 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0 Sep 25 10:46:40 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:40 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0" returned: 0 in 0.567s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:40 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0 Sep 25 10:46:40 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:41 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0" returned: 0 in 0.400s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "cinder-quobyte-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0" released by "delete_volume" :: held 1.041s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Created reservations ['ebc0dbca-71d4-4367-9624-b1859c6256be', 'e7ba71a0-660e-4783-bc8e-b37c946e48bc', '1215416c-75e3-4029-816a-c8cccbfa0a83', 'ee0dc992-17c2-4db4-b776-fc85e7e1b66c'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:41 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:46:41 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:41 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] GroupSnapshot 5ddbb83b-701b-4a10-a691-2a179bda6588: creating. Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Group snapshot 5ddbb83b-701b-4a10-a691-2a179bda6588: creating. {{(pid=86874) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Creating offline snapshot 0e654b19-7041-422b-94ba-7ba4c1ad2151 of volume 9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe18287-3154-4390-9fee-a753aa50983e]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:41 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 Sep 25 10:46:41 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:41 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.449s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:41 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:46:41 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Deleted volume successfully. Sep 25 10:46:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1e6f6919-b4cc-475e-867e-9a917792e23f tempest-TestServerVolumeAttachmentScenario-1662852952 None] Lock "cinder-ba4d9678-3c6e-41eb-9e11-87fdba8a21f0-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:42 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121" returned: 0 in 0.459s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:42 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 1G Sep 25 10:46:42 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:42 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 1G" returned: 0 in 0.616s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:42 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 Sep 25 10:46:42 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:43 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151" returned: 0 in 0.445s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:43 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:46:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:43 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 Sep 25 10:46:43 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:43 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151" returned: 0 in 0.328s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:43 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.info Sep 25 10:46:43 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:44 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.info" returned: 0 in 0.422s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:44 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:46:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:44 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.info Sep 25 10:46:44 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:44 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.info" returned: 0 in 0.375s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.802s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Creating offline snapshot 8a35e7d4-e4dd-42b7-a4d4-744ff920c487 of volume 064197a1-f93a-4b58-b7cd-fd2eb00c796d {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:46:44 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[668e0111-88aa-45a5-9b2b-a8f1640faccf]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:44 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d Sep 25 10:46:44 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:45 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d" returned: 0 in 0.639s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:45 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 1G Sep 25 10:46:45 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:45 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 1G" returned: 0 in 0.751s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:45 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 Sep 25 10:46:45 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:46 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487" returned: 0 in 0.536s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:46 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:46:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:46 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 Sep 25 10:46:46 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:47 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487" returned: 0 in 0.568s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:47 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.info Sep 25 10:46:47 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:47 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.info" returned: 0 in 0.605s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:47 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:46:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:47 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.info Sep 25 10:46:47 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:48 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.info" returned: 0 in 0.477s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.865s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:48 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=92,cinder:UPDATE=67,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:46:48 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-20ca5fa1-76fc-4cb6-9be5-0218292075d2 tempest-GroupSnapshotsTest-1292036940 None] group_snapshot 5ddbb83b-701b-4a10-a691-2a179bda6588: created successfully Sep 25 10:46:49 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] group_snapshot 5ddbb83b-701b-4a10-a691-2a179bda6588: deleting Sep 25 10:46:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] group_snapshot 5ddbb83b-701b-4a10-a691-2a179bda6588: deleting {{(pid=86874) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 10:46:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-0e654b19-7041-422b-94ba-7ba4c1ad2151" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-0e654b19-7041-422b-94ba-7ba4c1ad2151" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Deleting offline snapshot 0e654b19-7041-422b-94ba-7ba4c1ad2151 of volume 9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:46:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] snapshot_file for this snap is: volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:46:49 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf6cb9a-c9cc-4996-ad5c-59ec74e76ac1]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:49 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 Sep 25 10:46:49 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:50 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151" returned: 0 in 0.654s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:46:50 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d097892-7683-4b6a-8e78-6d0d963f6506]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:50 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 Sep 25 10:46:50 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:50 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121" returned: 0 in 0.495s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:50 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 Sep 25 10:46:50 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:51 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151" returned: 0 in 0.637s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:51 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151 Sep 25 10:46:51 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:52 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121.0e654b19-7041-422b-94ba-7ba4c1ad2151" returned: 0 in 0.535s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-0e654b19-7041-422b-94ba-7ba4c1ad2151" released by "_delete_snapshot" :: held 2.524s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121" released by "delete_snapshot" :: held 2.574s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-064197a1-f93a-4b58-b7cd-fd2eb00c796d" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-064197a1-f93a-4b58-b7cd-fd2eb00c796d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-8a35e7d4-e4dd-42b7-a4d4-744ff920c487" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-8a35e7d4-e4dd-42b7-a4d4-744ff920c487" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Deleting offline snapshot 8a35e7d4-e4dd-42b7-a4d4-744ff920c487 of volume 064197a1-f93a-4b58-b7cd-fd2eb00c796d {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:46:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] snapshot_file for this snap is: volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:46:52 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5281986f-d5d5-4dca-a557-f843873cf4ee]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:52 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 Sep 25 10:46:52 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:52 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487" returned: 0 in 0.741s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:46:53 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[15686281-ce19-45a3-9537-5d024daacac7]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:53 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d Sep 25 10:46:53 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:53 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d" returned: 0 in 0.564s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:53 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 Sep 25 10:46:53 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:54 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487" returned: 0 in 0.471s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:54 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487 Sep 25 10:46:54 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:54 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d.8a35e7d4-e4dd-42b7-a4d4-744ff920c487" returned: 0 in 0.470s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-8a35e7d4-e4dd-42b7-a4d4-744ff920c487" released by "_delete_snapshot" :: held 2.490s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-064197a1-f93a-4b58-b7cd-fd2eb00c796d" released by "delete_snapshot" :: held 2.533s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:54 devstack cinder-volume[86874]: WARNING cinder.quota [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1283366767 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1283366767, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:46:54 devstack cinder-volume[86874]: WARNING cinder.quota [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1283366767 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1283366767, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:46:55 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Created reservations ['b4cacb92-0440-4e0a-b677-b4c639aecc7d', 'ed75ecf3-3be5-4223-9e3e-731861836af9', 'a5c002fe-6f89-4362-9d6f-16d55fbe9347', 'ebbb196c-ca8f-4063-8120-93b35088e189'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:55 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] Created reservations ['0029a601-19d2-47ee-8933-22a657d6aa3b', '436989e5-9b7e-467c-be71-8f0642c60bbd', '7b34a8de-288f-45f9-a923-f275fd23be63', '4517db0d-c765-4a46-b648-740478300a30'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:55 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-497b1e55-c44f-4baa-a1c8-d7111c91d28f tempest-GroupSnapshotsTest-1292036940 None] group_snapshot 5ddbb83b-701b-4a10-a691-2a179bda6588: deleted successfully Sep 25 10:46:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-064197a1-f93a-4b58-b7cd-fd2eb00c796d" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-064197a1-f93a-4b58-b7cd-fd2eb00c796d" acquired by "delete_volume" :: waited 0.033s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:57 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff363ee5-7c61-4958-ac09-3ec6a6adf402]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:57 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d Sep 25 10:46:57 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:58 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d" returned: 0 in 0.931s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:58 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d Sep 25 10:46:58 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:59 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-064197a1-f93a-4b58-b7cd-fd2eb00c796d" returned: 0 in 0.597s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-064197a1-f93a-4b58-b7cd-fd2eb00c796d" released by "delete_volume" :: held 1.715s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121" acquired by "delete_volume" :: waited 0.061s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5445a73e-f5f2-44c8-a12f-0068143b33b6]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:59 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 Sep 25 10:46:59 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Flow 'volume_create_manager' (505fd0bf-5838-40e2-9fa9-6db98b10406d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5ae242-1a81-423d-b6bf-214152f5a6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5ae242-1a81-423d-b6bf-214152f5a6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2074519798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3670dad4-1894-4d3f-af21-0400e1d47061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353111e8abc74f369aa3088638f3553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:59Z,use_quota=True,user_id='469f16f7339c483cb3856ec3e35e5a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f3015d-8527-425e-b0d5-cb94d5569beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f3015d-8527-425e-b0d5-cb94d5569beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e9c2f6-4b2e-4a43-a3ab-25e644ca5153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e9c2f6-4b2e-4a43-a3ab-25e644ca5153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3670dad4-1894-4d3f-af21-0400e1d47061', 'volume_name': 'volume-3670dad4-1894-4d3f-af21-0400e1d47061', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4765d9db-8481-4a6a-8146-c02dd83e7f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4765d9db-8481-4a6a-8146-c02dd83e7f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd80259-2249-49c0-9550-3b2e9697a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:59 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Volume 3670dad4-1894-4d3f-af21-0400e1d47061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3670dad4-1894-4d3f-af21-0400e1d47061', 'volume_size': 1} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2074519798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3670dad4-1894-4d3f-af21-0400e1d47061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353111e8abc74f369aa3088638f3553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:59Z,use_quota=True,user_id='469f16f7339c483cb3856ec3e35e5a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Creating volume 3670dad4-1894-4d3f-af21-0400e1d47061 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:59 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3670dad4-1894-4d3f-af21-0400e1d47061 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:59 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3670dad4-1894-4d3f-af21-0400e1d47061 1073741824 Sep 25 10:46:59 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:59 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121" returned: 0 in 0.589s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:59 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121 Sep 25 10:46:59 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:00 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3670dad4-1894-4d3f-af21-0400e1d47061 1073741824" returned: 0 in 0.610s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:00 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121" returned: 0 in 0.414s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-9fcaadb5-e71f-49b3-b9cd-8da57c2cf121" released by "delete_volume" :: held 1.202s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3670dad4-1894-4d3f-af21-0400e1d47061 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:00 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3670dad4-1894-4d3f-af21-0400e1d47061 Sep 25 10:47:00 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:00 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Created reservations ['8056be78-bbba-4cf3-b511-b9de7b929e72'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:00 devstack cinder-volume[86874]: WARNING cinder.quota [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1283366767 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1283366767, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:47:00 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Created reservations ['b7f23056-faf0-46bc-9dad-30029ce862f5', '42c65738-faf5-4799-931e-c8bc44f9ddf8', '805c90e7-5ba9-4f62-adc3-49122b7a41b5', '03078f7e-b5de-4233-99e2-5ef0581536e7'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:00 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Created reservations ['6b2e3f92-e70d-48d1-a655-33500b709b65', 'accf1973-4b7f-4af2-88ad-45b02648bedd', 'a419f053-e57c-499e-891f-f30369e1612c', 'a27f33b9-5075-4de2-b54f-73c41105debb'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:00 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3670dad4-1894-4d3f-af21-0400e1d47061" returned: 0 in 0.534s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:47:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd80259-2249-49c0-9550-3b2e9697a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3670dad4-1894-4d3f-af21-0400e1d47061', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7207cebc-a3a6-4fec-80b2-4a647d8bb4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:01 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Volume volume-3670dad4-1894-4d3f-af21-0400e1d47061 (3670dad4-1894-4d3f-af21-0400e1d47061): created successfully Sep 25 10:47:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7207cebc-a3a6-4fec-80b2-4a647d8bb4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Flow 'volume_create_manager' (505fd0bf-5838-40e2-9fa9-6db98b10406d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:01 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-591ee2b8-fdb6-42ca-982a-3d948b68a5b9 tempest-AttachVolumeTestJSON-1139818827 None] Created volume successfully. Sep 25 10:47:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:01 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:47:01 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:01 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.440s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:01 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:01 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2e5bc7d9-f6d7-4806-8267-438b876fb825 tempest-GroupSnapshotsTest-1292036940 None] Delete group completed successfully. Sep 25 10:47:02 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b94bd2e5-6d4a-4c3f-9d3e-07bb16d14879 tempest-GroupSnapshotsTest-1292036940 None] Group tempest-GroupSnapshotsTest-Group-1619452368: creating Sep 25 10:47:02 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b94bd2e5-6d4a-4c3f-9d3e-07bb16d14879 tempest-GroupSnapshotsTest-1292036940 None] Group tempest-GroupSnapshotsTest-Group-1619452368: created successfully Sep 25 10:47:02 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b94bd2e5-6d4a-4c3f-9d3e-07bb16d14879 tempest-GroupSnapshotsTest-1292036940 None] Create group completed successfully. Sep 25 10:47:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a03abd7a-9e83-4052-b6f6-baf1468e6262 req-4d16d0b3-3ddb-4f53-b8af-45cbfe2e8045 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a03abd7a-9e83-4052-b6f6-baf1468e6262 req-4d16d0b3-3ddb-4f53-b8af-45cbfe2e8045 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a03abd7a-9e83-4052-b6f6-baf1468e6262 req-4d16d0b3-3ddb-4f53-b8af-45cbfe2e8045 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-a03abd7a-9e83-4052-b6f6-baf1468e6262 req-4d16d0b3-3ddb-4f53-b8af-45cbfe2e8045 tempest-AttachVolumeTestJSON-1139818827 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-3670dad4-1894-4d3f-af21-0400e1d47061', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28cde499-571e-4a03-97c0-84ca7ff701d9', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:47:03 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-a03abd7a-9e83-4052-b6f6-baf1468e6262 req-4d16d0b3-3ddb-4f53-b8af-45cbfe2e8045 tempest-AttachVolumeTestJSON-1139818827 None] attachment_update completed successfully. Sep 25 10:47:04 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:47:04 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Flow 'volume_create_manager' (d61ff5c7-700c-4aeb-b9e8-9320a11e9549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:04 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c506661c-8c45-49b3-b785-4e71df08eaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:04 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c506661c-8c45-49b3-b785-4e71df08eaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2122691119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=216e8adc-bf10-4258-b75e-cf6ccb182fd3,host='devstack@QuobyteHD#QuobyteHD',id=48eee2fe-56d9-4b44-8664-e124d71da379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394959bb2ebf4f6da4088b76d707a9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:05Z,use_quota=True,user_id='aca4589e02734d0cb63ab52ec7a7f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9454337f-ee5f-4a92-b7be-0c22a7e300b7),volume_type_id=9454337f-ee5f-4a92-b7be-0c22a7e300b7)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:04 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46b14e4-7769-451d-8f49-6bf8b3897b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:04 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46b14e4-7769-451d-8f49-6bf8b3897b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34819d41-198d-4bc3-ac15-42860cffbeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34819d41-198d-4bc3-ac15-42860cffbeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48eee2fe-56d9-4b44-8664-e124d71da379', 'volume_name': 'volume-48eee2fe-56d9-4b44-8664-e124d71da379', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc2466e-6440-4d82-9b4a-6f5382b2ee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc2466e-6440-4d82-9b4a-6f5382b2ee31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de387ed8-2fb3-4a0e-9319-2ffaf129154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:05 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Volume 48eee2fe-56d9-4b44-8664-e124d71da379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48eee2fe-56d9-4b44-8664-e124d71da379', 'volume_size': 1} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=216e8adc-bf10-4258-b75e-cf6ccb182fd3,created_at=2026-09-25T08:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2122691119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=216e8adc-bf10-4258-b75e-cf6ccb182fd3,host='devstack@QuobyteHD#QuobyteHD',id=48eee2fe-56d9-4b44-8664-e124d71da379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394959bb2ebf4f6da4088b76d707a9f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:05Z,use_quota=True,user_id='aca4589e02734d0cb63ab52ec7a7f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9454337f-ee5f-4a92-b7be-0c22a7e300b7),volume_type_id=9454337f-ee5f-4a92-b7be-0c22a7e300b7)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Creating volume 48eee2fe-56d9-4b44-8664-e124d71da379 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:47:05 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:05 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379 1073741824 Sep 25 10:47:05 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:05 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379 1073741824" returned: 0 in 0.755s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:05 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379 Sep 25 10:47:05 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:06 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379" returned: 0 in 0.404s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:47:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de387ed8-2fb3-4a0e-9319-2ffaf129154e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48eee2fe-56d9-4b44-8664-e124d71da379', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b138bfcb-6484-4d69-a0b1-c02a5624ad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:06 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Volume volume-48eee2fe-56d9-4b44-8664-e124d71da379 (48eee2fe-56d9-4b44-8664-e124d71da379): created successfully Sep 25 10:47:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b138bfcb-6484-4d69-a0b1-c02a5624ad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Flow 'volume_create_manager' (d61ff5c7-700c-4aeb-b9e8-9320a11e9549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:06 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4c70fbe1-dda7-4efa-ba8c-b9450fde33df tempest-GroupSnapshotsTest-1292036940 None] Created volume successfully. Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Flow 'volume_create_manager' (03053fcd-738b-4e40-9d35-f59fddef6a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8acf53-d914-4399-9449-078e16401c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8acf53-d914-4399-9449-078e16401c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-826349219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c754f1-5518-4f16-ad0f-cd109a525e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353111e8abc74f369aa3088638f3553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:08Z,use_quota=True,user_id='469f16f7339c483cb3856ec3e35e5a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e140d221-d25c-4a59-ba9d-6a05dd114818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e140d221-d25c-4a59-ba9d-6a05dd114818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca24d4a6-4df7-43ef-b0a8-fffb55ca74ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca24d4a6-4df7-43ef-b0a8-fffb55ca74ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c754f1-5518-4f16-ad0f-cd109a525e8a', 'volume_name': 'volume-14c754f1-5518-4f16-ad0f-cd109a525e8a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a027f41e-0987-4f1f-92e4-270a12dc8a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a027f41e-0987-4f1f-92e4-270a12dc8a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917ad78d-5208-48ce-8db5-88edb618f154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:07 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Volume 14c754f1-5518-4f16-ad0f-cd109a525e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c754f1-5518-4f16-ad0f-cd109a525e8a', 'volume_size': 1} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-826349219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c754f1-5518-4f16-ad0f-cd109a525e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353111e8abc74f369aa3088638f3553a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:08Z,use_quota=True,user_id='469f16f7339c483cb3856ec3e35e5a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Creating volume 14c754f1-5518-4f16-ad0f-cd109a525e8a {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:47:07 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:47:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-14c754f1-5518-4f16-ad0f-cd109a525e8a 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:07 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-14c754f1-5518-4f16-ad0f-cd109a525e8a 1073741824 Sep 25 10:47:07 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:08 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] GroupSnapshot 235424b9-2725-4f5e-b76e-6d016d785360: creating. Sep 25 10:47:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] Group snapshot 235424b9-2725-4f5e-b76e-6d016d785360: creating. {{(pid=86874) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 10:47:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:08 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-14c754f1-5518-4f16-ad0f-cd109a525e8a 1073741824" returned: 0 in 0.779s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-14c754f1-5518-4f16-ad0f-cd109a525e8a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:08 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-14c754f1-5518-4f16-ad0f-cd109a525e8a Sep 25 10:47:08 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:09 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-14c754f1-5518-4f16-ad0f-cd109a525e8a" returned: 0 in 0.397s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:47:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.657s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] Creating offline snapshot c56cf678-c489-4b18-9f87-fd257cf5d02b of volume 48eee2fe-56d9-4b44-8664-e124d71da379 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:47:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917ad78d-5208-48ce-8db5-88edb618f154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c754f1-5518-4f16-ad0f-cd109a525e8a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8d1d1c-5916-4c1d-a949-d19256e8fb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:09 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8ccfc3-eab4-4469-b845-7419406f1fcc]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:09 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Volume volume-14c754f1-5518-4f16-ad0f-cd109a525e8a (14c754f1-5518-4f16-ad0f-cd109a525e8a): created successfully Sep 25 10:47:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8d1d1c-5916-4c1d-a949-d19256e8fb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Flow 'volume_create_manager' (03053fcd-738b-4e40-9d35-f59fddef6a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:09 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-976b13d9-6750-4725-9c5f-3b5c28be34ac tempest-AttachVolumeTestJSON-1139818827 None] Created volume successfully. Sep 25 10:47:09 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379 Sep 25 10:47:09 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:09 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379" returned: 0 in 0.552s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:09 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b 1G Sep 25 10:47:09 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:10 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b 1G" returned: 0 in 0.738s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48eee2fe-56d9-4b44-8664-e124d71da379 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:10 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48eee2fe-56d9-4b44-8664-e124d71da379 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b Sep 25 10:47:10 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:10 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:INSERT=26,cinder:SELECT=122,cinder:UPDATE=112,cinder:DELETE=2 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:47:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-56b14e1c-a75b-4a05-b6eb-8a56b65925d2 req-2a314a59-2262-418a-9a37-51784f8ad029 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:10 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48eee2fe-56d9-4b44-8664-e124d71da379 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b" returned: 0 in 0.446s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:10 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:47:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:10 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b Sep 25 10:47:10 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:11 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b" returned: 0 in 0.368s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:11 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.info Sep 25 10:47:11 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:11 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.info" returned: 0 in 0.353s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:11 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:47:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:11 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.info Sep 25 10:47:11 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:12 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.info" returned: 0 in 0.378s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.983s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-56b14e1c-a75b-4a05-b6eb-8a56b65925d2 req-2a314a59-2262-418a-9a37-51784f8ad029 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.361s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-56b14e1c-a75b-4a05-b6eb-8a56b65925d2 req-2a314a59-2262-418a-9a37-51784f8ad029 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-56b14e1c-a75b-4a05-b6eb-8a56b65925d2 req-2a314a59-2262-418a-9a37-51784f8ad029 tempest-AttachVolumeTestJSON-1139818827 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-14c754f1-5518-4f16-ad0f-cd109a525e8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5429ba0-2851-44c3-b860-456d5d1a87c3', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:47:12 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2afaf34b-ca99-4916-88a7-b718f804a643 tempest-GroupSnapshotsTest-1292036940 None] group_snapshot 235424b9-2725-4f5e-b76e-6d016d785360: created successfully Sep 25 10:47:12 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-56b14e1c-a75b-4a05-b6eb-8a56b65925d2 req-2a314a59-2262-418a-9a37-51784f8ad029 tempest-AttachVolumeTestJSON-1139818827 None] attachment_update completed successfully. Sep 25 10:47:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] group_snapshot 235424b9-2725-4f5e-b76e-6d016d785360: deleting Sep 25 10:47:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] group_snapshot 235424b9-2725-4f5e-b76e-6d016d785360: deleting {{(pid=86874) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 10:47:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-48eee2fe-56d9-4b44-8664-e124d71da379" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-48eee2fe-56d9-4b44-8664-e124d71da379" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-c56cf678-c489-4b18-9f87-fd257cf5d02b" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-c56cf678-c489-4b18-9f87-fd257cf5d02b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Deleting offline snapshot c56cf678-c489-4b18-9f87-fd257cf5d02b of volume 48eee2fe-56d9-4b44-8664-e124d71da379 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:47:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] snapshot_file for this snap is: volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:47:13 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab5331f-ae92-4663-9fbb-07b936cfcb59]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:13 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b Sep 25 10:47:13 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:13 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b" returned: 0 in 0.572s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48eee2fe-56d9-4b44-8664-e124d71da379(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:47:13 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28c840f-1231-4251-9b19-707f7e1d43b0]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:14 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379 Sep 25 10:47:14 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:14 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379" returned: 0 in 0.557s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:14 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b Sep 25 10:47:14 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:15 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b" returned: 0 in 0.652s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:15 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b Sep 25 10:47:15 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:15 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379.c56cf678-c489-4b18-9f87-fd257cf5d02b" returned: 0 in 0.397s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-c56cf678-c489-4b18-9f87-fd257cf5d02b" released by "_delete_snapshot" :: held 2.442s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-48eee2fe-56d9-4b44-8664-e124d71da379" released by "delete_snapshot" :: held 2.491s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:15 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-d615c988-c1e8-4209-8cb8-958bb1596216 req-4819d443-6417-490d-8c0f-7c394f7bbc6f tempest-AttachVolumeTestJSON-1139818827 None] Terminate volume connection completed successfully. Sep 25 10:47:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-d615c988-c1e8-4209-8cb8-958bb1596216 req-4819d443-6417-490d-8c0f-7c394f7bbc6f tempest-AttachVolumeTestJSON-1139818827 None] Deleting attachment 28cde499-571e-4a03-97c0-84ca7ff701d9. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:47:15 devstack cinder-volume[86874]: WARNING cinder.quota [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-946291396 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-946291396, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:47:15 devstack cinder-volume[86874]: WARNING cinder.quota [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-946291396 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-946291396, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:47:15 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] Created reservations ['e0f9095f-d783-4180-827d-9f6c02f35236', '770e90b2-12f1-499a-b3d9-765ffbda4a99', '4d58852a-bf24-4dc0-8585-ed57b5b3654f', '346b682d-1783-4cef-8276-bfa84daead2a'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a25040aa-485f-456b-96f2-920d42d20654 tempest-GroupSnapshotsTest-1292036940 None] group_snapshot 235424b9-2725-4f5e-b76e-6d016d785360: deleted successfully Sep 25 10:47:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "cinder-quobyte-48eee2fe-56d9-4b44-8664-e124d71da379" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-48eee2fe-56d9-4b44-8664-e124d71da379" acquired by "delete_volume" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:17 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8509dd-dc0f-4607-a0f8-f2fc1508eca5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:17 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379 Sep 25 10:47:17 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:18 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379" returned: 0 in 0.801s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:18 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379 Sep 25 10:47:18 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:18 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-48eee2fe-56d9-4b44-8664-e124d71da379" returned: 0 in 0.428s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Lock "cinder-quobyte-48eee2fe-56d9-4b44-8664-e124d71da379" released by "delete_volume" :: held 1.436s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:18 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Created reservations ['04eea2c4-688b-4179-8871-c8ccc6ec1a00'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:18 devstack cinder-volume[86874]: WARNING cinder.quota [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-946291396 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-946291396, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:47:18 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Created reservations ['43171335-a980-4bee-a1c9-7f91b02857c0', '9a5468d6-83dc-460d-a627-0c3163d105f4', '09d04152-4e8f-4897-96a6-0ed3bb6966ed', '391a9205-3a18-4c1d-bdb9-248c3ba233b0'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Flow 'volume_create_manager' (677e86e2-a4b6-49aa-bf15-725df213f417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bd8b45-a430-4328-8ae9-9f8f2d6bd5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bd8b45-a430-4328-8ae9-9f8f2d6bd5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1504866168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09d0c6a-4162-48a7-916b-7feb0ec07b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5007e87c0a54a34a4fa34d76dd8ea2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:19Z,use_quota=True,user_id='4fd1ace02e3e46a09d32d07e1be07550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50f2bdb-a6fb-4954-9273-7b09b96adb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50f2bdb-a6fb-4954-9273-7b09b96adb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1864a41-7250-4da0-aaf0-a394d5bef7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1864a41-7250-4da0-aaf0-a394d5bef7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd09d0c6a-4162-48a7-916b-7feb0ec07b47', 'volume_name': 'volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c96920-d658-4590-9334-ebae91100054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c96920-d658-4590-9334-ebae91100054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ceaf126-c83b-45b1-9ac5-dc0af1173895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:19 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Volume d09d0c6a-4162-48a7-916b-7feb0ec07b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47', 'volume_size': 1} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1504866168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09d0c6a-4162-48a7-916b-7feb0ec07b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5007e87c0a54a34a4fa34d76dd8ea2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:19Z,use_quota=True,user_id='4fd1ace02e3e46a09d32d07e1be07550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Creating volume d09d0c6a-4162-48a7-916b-7feb0ec07b47 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:47:19 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:19 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-8dd4f19b-fcf6-406c-b8ac-f3977dd0baf8 req-545bd61a-9ff4-43f8-b2bc-f9afdee96a51 tempest-AttachVolumeTestJSON-1139818827 None] Terminate volume connection completed successfully. Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-8dd4f19b-fcf6-406c-b8ac-f3977dd0baf8 req-545bd61a-9ff4-43f8-b2bc-f9afdee96a51 tempest-AttachVolumeTestJSON-1139818827 None] Deleting attachment f5429ba0-2851-44c3-b860-456d5d1a87c3. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:47:19 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47 1073741824 Sep 25 10:47:19 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:19 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:47:19 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:19 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.432s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:19 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-0536c46a-69a9-4a20-9f0f-882dce4e9975 tempest-GroupSnapshotsTest-1292036940 None] Delete group completed successfully. Sep 25 10:47:19 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47 1073741824" returned: 0 in 0.674s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:19 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47 Sep 25 10:47:19 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:20 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47" returned: 0 in 0.457s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:47:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ceaf126-c83b-45b1-9ac5-dc0af1173895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2105224-0985-4fae-b3e6-cf32ac8a0e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:20 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Volume volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47 (d09d0c6a-4162-48a7-916b-7feb0ec07b47): created successfully Sep 25 10:47:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2105224-0985-4fae-b3e6-cf32ac8a0e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Flow 'volume_create_manager' (677e86e2-a4b6-49aa-bf15-725df213f417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:20 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-74b9e783-1feb-4445-9891-2296477833db tempest-AttachVolumeNegativeTest-950702000 None] Created volume successfully. Sep 25 10:47:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-78703e43-e9d0-42ee-bf85-a9cfc90b49ba req-7b861451-a2fe-4604-89b2-b9370a570823 tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-78703e43-e9d0-42ee-bf85-a9cfc90b49ba req-7b861451-a2fe-4604-89b2-b9370a570823 tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-78703e43-e9d0-42ee-bf85-a9cfc90b49ba req-7b861451-a2fe-4604-89b2-b9370a570823 tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-78703e43-e9d0-42ee-bf85-a9cfc90b49ba req-7b861451-a2fe-4604-89b2-b9370a570823 tempest-AttachVolumeNegativeTest-950702000 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce04ce34-e941-471c-a192-dbf90a9361ec', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:47:22 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-78703e43-e9d0-42ee-bf85-a9cfc90b49ba req-7b861451-a2fe-4604-89b2-b9370a570823 tempest-AttachVolumeNegativeTest-950702000 None] attachment_update completed successfully. Sep 25 10:47:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:47:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:26 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:47:26 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:26 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.542s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:47:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:47:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:47:27 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-53616d0f-125a-4fb6-a2dd-d43b0daba555 req-3bc3bfaa-98ca-4176-8cfe-5f711a6cd773 tempest-AttachVolumeNegativeTest-950702000 None] Terminate volume connection completed successfully. Sep 25 10:47:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-53616d0f-125a-4fb6-a2dd-d43b0daba555 req-3bc3bfaa-98ca-4176-8cfe-5f711a6cd773 tempest-AttachVolumeNegativeTest-950702000 None] Deleting attachment ce04ce34-e941-471c-a192-dbf90a9361ec. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:47:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "cinder-14c754f1-5518-4f16-ad0f-cd109a525e8a-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Lock "cinder-14c754f1-5518-4f16-ad0f-cd109a525e8a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "cinder-quobyte-14c754f1-5518-4f16-ad0f-cd109a525e8a" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Lock "cinder-quobyte-14c754f1-5518-4f16-ad0f-cd109a525e8a" acquired by "delete_volume" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:29 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[538433a0-54c4-4e8e-917f-a77c6851809c]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-14c754f1-5518-4f16-ad0f-cd109a525e8a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:30 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-14c754f1-5518-4f16-ad0f-cd109a525e8a Sep 25 10:47:30 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:30 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-14c754f1-5518-4f16-ad0f-cd109a525e8a" returned: 0 in 0.754s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-14c754f1-5518-4f16-ad0f-cd109a525e8a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:30 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-14c754f1-5518-4f16-ad0f-cd109a525e8a Sep 25 10:47:30 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:31 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-14c754f1-5518-4f16-ad0f-cd109a525e8a" returned: 0 in 0.477s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Lock "cinder-quobyte-14c754f1-5518-4f16-ad0f-cd109a525e8a" released by "delete_volume" :: held 1.306s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:31 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Created reservations ['94e4f004-33da-4084-a0dc-f7f17e04b60b', '2313bf98-a58a-4d62-be11-c016fc9190d4', '794d5f7f-094f-4b84-ad8d-3199fe38b20a', '64507cc0-99af-4cff-9c1b-2da4e9c0741e'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:31 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:47:31 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:31 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.373s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:31 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:31 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Deleted volume successfully. Sep 25 10:47:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-87705f74-4592-42e6-b64e-a91b6caa62b1 tempest-AttachVolumeTestJSON-1139818827 None] Lock "cinder-14c754f1-5518-4f16-ad0f-cd109a525e8a-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "cinder-3670dad4-1894-4d3f-af21-0400e1d47061-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Lock "cinder-3670dad4-1894-4d3f-af21-0400e1d47061-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "cinder-quobyte-3670dad4-1894-4d3f-af21-0400e1d47061" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Lock "cinder-quobyte-3670dad4-1894-4d3f-af21-0400e1d47061" acquired by "delete_volume" :: waited 0.025s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:32 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d4a599-85d7-4ee3-a550-18d4622f5ee1]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3670dad4-1894-4d3f-af21-0400e1d47061 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:32 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3670dad4-1894-4d3f-af21-0400e1d47061 Sep 25 10:47:32 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:33 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3670dad4-1894-4d3f-af21-0400e1d47061" returned: 0 in 0.701s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3670dad4-1894-4d3f-af21-0400e1d47061 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:33 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3670dad4-1894-4d3f-af21-0400e1d47061 Sep 25 10:47:33 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:33 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3670dad4-1894-4d3f-af21-0400e1d47061" returned: 0 in 0.588s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Lock "cinder-quobyte-3670dad4-1894-4d3f-af21-0400e1d47061" released by "delete_volume" :: held 1.375s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:33 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ca2c5e86-035f-4c61-bb5c-d384ff980b85 tempest-GroupSnapshotsV319Test-1999797305 None] Group tempest-GroupSnapshotsV319Test-Group-806304544: creating Sep 25 10:47:33 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Created reservations ['9785878b-31ee-4b62-b11c-f1b1ce04c906', 'e3067969-6314-4c78-932e-33e995f1c434', 'c170493c-b8ee-4ab6-a8be-a52f449dde5d', '2d82d16b-9639-41aa-8b2f-66a3029ca1d8'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:33 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ca2c5e86-035f-4c61-bb5c-d384ff980b85 tempest-GroupSnapshotsV319Test-1999797305 None] Group tempest-GroupSnapshotsV319Test-Group-806304544: created successfully Sep 25 10:47:33 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ca2c5e86-035f-4c61-bb5c-d384ff980b85 tempest-GroupSnapshotsV319Test-1999797305 None] Create group completed successfully. Sep 25 10:47:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:33 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:47:33 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:34 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.380s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:34 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:34 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Deleted volume successfully. Sep 25 10:47:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-49278547-4655-4630-aa6e-4471f69cd5f2 tempest-AttachVolumeTestJSON-1139818827 None] Lock "cinder-3670dad4-1894-4d3f-af21-0400e1d47061-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "cinder-4e708ae3-c2d3-4fad-872a-ef94bc948299-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Lock "cinder-4e708ae3-c2d3-4fad-872a-ef94bc948299-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "cinder-quobyte-4e708ae3-c2d3-4fad-872a-ef94bc948299" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Lock "cinder-quobyte-4e708ae3-c2d3-4fad-872a-ef94bc948299" acquired by "delete_volume" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:34 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5914e3dd-0730-4b47-9fbd-68635eac8386]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4e708ae3-c2d3-4fad-872a-ef94bc948299 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:35 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4e708ae3-c2d3-4fad-872a-ef94bc948299 Sep 25 10:47:35 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:35 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4e708ae3-c2d3-4fad-872a-ef94bc948299" returned: 0 in 0.613s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4e708ae3-c2d3-4fad-872a-ef94bc948299 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:35 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4e708ae3-c2d3-4fad-872a-ef94bc948299 Sep 25 10:47:35 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Flow 'volume_create_manager' (8ec3a61f-cbc9-482a-8d66-0894d422db46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53294dd4-50b8-4fda-8caa-43f9efaf7dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53294dd4-50b8-4fda-8caa-43f9efaf7dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1990591211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c43058e9-0115-4c4f-a517-2868a758b17a,host='devstack@QuobyteHD#QuobyteHD',id=9182eeff-ce74-4c7b-b5ec-b65741d4bb01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4729443292be4a41973bcbdcc0a0b2ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:36Z,use_quota=True,user_id='53eb5a6691044470a7d29b129edbb1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0af0a763-879b-4e16-9a49-cca7e5e254f5),volume_type_id=0af0a763-879b-4e16-9a49-cca7e5e254f5)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ada431-93e7-4343-b82f-f958cd320a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ada431-93e7-4343-b82f-f958cd320a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8204e730-9f7f-40d0-a133-6e5920298d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8204e730-9f7f-40d0-a133-6e5920298d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9182eeff-ce74-4c7b-b5ec-b65741d4bb01', 'volume_name': 'volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21726b27-fa4c-4515-8fc1-3436959ac090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21726b27-fa4c-4515-8fc1-3436959ac090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e9239f-30dd-4b30-82e5-57674d1a548a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:35 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Volume 9182eeff-ce74-4c7b-b5ec-b65741d4bb01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01', 'volume_size': 1} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c43058e9-0115-4c4f-a517-2868a758b17a,created_at=2026-09-25T08:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1990591211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c43058e9-0115-4c4f-a517-2868a758b17a,host='devstack@QuobyteHD#QuobyteHD',id=9182eeff-ce74-4c7b-b5ec-b65741d4bb01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4729443292be4a41973bcbdcc0a0b2ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:36Z,use_quota=True,user_id='53eb5a6691044470a7d29b129edbb1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0af0a763-879b-4e16-9a49-cca7e5e254f5),volume_type_id=0af0a763-879b-4e16-9a49-cca7e5e254f5)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Creating volume 9182eeff-ce74-4c7b-b5ec-b65741d4bb01 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:47:35 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:47:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:35 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 1073741824 Sep 25 10:47:35 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:36 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4e708ae3-c2d3-4fad-872a-ef94bc948299" returned: 0 in 0.503s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Lock "cinder-quobyte-4e708ae3-c2d3-4fad-872a-ef94bc948299" released by "delete_volume" :: held 1.187s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Created reservations ['1267252a-15aa-40c6-b717-6a9bec5e73c5', '1bc76926-7e84-454a-b634-9536551d0f98', 'c58efb3c-359b-4d1d-b93b-adb79957eef8', '5a6fe43b-1681-45c0-831a-695b91dfcfde'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:36 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:47:36 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "cinder-d09d0c6a-4162-48a7-916b-7feb0ec07b47-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Lock "cinder-d09d0c6a-4162-48a7-916b-7feb0ec07b47-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "cinder-quobyte-d09d0c6a-4162-48a7-916b-7feb0ec07b47" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Lock "cinder-quobyte-d09d0c6a-4162-48a7-916b-7feb0ec07b47" acquired by "delete_volume" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4218e4d-1c4d-4ded-b0bd-0004d1542661]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:36 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 1073741824" returned: 0 in 0.800s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:36 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.443s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:36 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Deleted volume successfully. Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f688a3fb-dadb-41d8-9b21-be9b3d96a1a2 tempest-AttachVolumeTestJSON-1139818827 None] Lock "cinder-4e708ae3-c2d3-4fad-872a-ef94bc948299-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:36 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47 Sep 25 10:47:36 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:36 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 Sep 25 10:47:36 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:37 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47" returned: 0 in 0.692s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:37 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47 Sep 25 10:47:37 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:37 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01" returned: 0 in 0.625s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:47:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e9239f-30dd-4b30-82e5-57674d1a548a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb91e73-2266-4fbc-bd9b-b022cac0f553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:37 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Volume volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 (9182eeff-ce74-4c7b-b5ec-b65741d4bb01): created successfully Sep 25 10:47:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb91e73-2266-4fbc-bd9b-b022cac0f553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Flow 'volume_create_manager' (8ec3a61f-cbc9-482a-8d66-0894d422db46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:37 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-cf58cc39-3d5d-44ff-a0de-7aae813fdeca tempest-GroupSnapshotsV319Test-1999797305 None] Created volume successfully. Sep 25 10:47:37 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d09d0c6a-4162-48a7-916b-7feb0ec07b47" returned: 0 in 0.478s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Lock "cinder-quobyte-d09d0c6a-4162-48a7-916b-7feb0ec07b47" released by "delete_volume" :: held 1.228s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:37 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Created reservations ['55baa6ee-2769-41fd-aae6-27a73fa1ee28', 'f6997fc7-0335-4f85-8471-0855931a51cc', '2d51b391-4aa3-45bc-a9e1-d37188ba7d35', 'a07b1156-e372-4c99-825b-fbdc85d0a687'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:38 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:47:38 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:38 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.466s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:38 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Deleted volume successfully. Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a88e63a2-edde-4621-9f8f-eea1de431c45 tempest-AttachVolumeNegativeTest-950702000 None] Lock "cinder-d09d0c6a-4162-48a7-916b-7feb0ec07b47-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:38 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] GroupSnapshot c24491b9-fb5a-40f3-bb01-89bfee83b787: creating. Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] Group snapshot c24491b9-fb5a-40f3-bb01-89bfee83b787: creating. {{(pid=86874) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] Creating offline snapshot af303cd9-64f6-4b71-8b51-b6cfc1e89267 of volume 9182eeff-ce74-4c7b-b5ec-b65741d4bb01 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcb45c4-b5a1-47e6-82f9-1da6ecd46598]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "cinder-fdafc901-d451-4413-b760-78af3cbf78dc-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Lock "cinder-fdafc901-d451-4413-b760-78af3cbf78dc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:39 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 Sep 25 10:47:39 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "cinder-quobyte-fdafc901-d451-4413-b760-78af3cbf78dc" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Lock "cinder-quobyte-fdafc901-d451-4413-b760-78af3cbf78dc" acquired by "delete_volume" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:39 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[404d0a95-3e6c-4717-b67d-1f63ec28fdfb]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fdafc901-d451-4413-b760-78af3cbf78dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:39 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fdafc901-d451-4413-b760-78af3cbf78dc Sep 25 10:47:39 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:39 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01" returned: 0 in 0.669s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:39 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 1G Sep 25 10:47:39 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:39 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fdafc901-d451-4413-b760-78af3cbf78dc" returned: 0 in 0.569s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fdafc901-d451-4413-b760-78af3cbf78dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:39 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fdafc901-d451-4413-b760-78af3cbf78dc Sep 25 10:47:39 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:40 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 1G" returned: 0 in 0.776s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:40 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fdafc901-d451-4413-b760-78af3cbf78dc" returned: 0 in 0.479s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:40 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 Sep 25 10:47:40 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Lock "cinder-quobyte-fdafc901-d451-4413-b760-78af3cbf78dc" released by "delete_volume" :: held 1.161s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:40 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Created reservations ['ca5e364e-143c-4df1-93d2-05a049576f23', '2b2550bc-2b41-464f-88f4-8b06b6e1d5d6', 'b4d42b2a-0e9d-4e58-b61c-1c6c10e5292d', '206c2739-92bd-4ab3-ae47-a9da65079cff'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:40 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:47:40 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:40 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267" returned: 0 in 0.410s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:40 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:47:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:40 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 Sep 25 10:47:40 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:41 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.387s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:41 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:41 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Deleted volume successfully. Sep 25 10:47:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0d071197-ac4e-44c7-8b68-a4e63c5eb819 tempest-AttachVolumeNegativeTest-950702000 None] Lock "cinder-fdafc901-d451-4413-b760-78af3cbf78dc-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:41 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267" returned: 0 in 0.464s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:41 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.info Sep 25 10:47:41 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:41 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.info" returned: 0 in 0.374s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:41 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:47:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:41 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.info Sep 25 10:47:41 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "cinder-344f20ef-1beb-40a3-85d9-595fbbb733fc-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Lock "cinder-344f20ef-1beb-40a3-85d9-595fbbb733fc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "cinder-quobyte-344f20ef-1beb-40a3-85d9-595fbbb733fc" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Lock "cinder-quobyte-344f20ef-1beb-40a3-85d9-595fbbb733fc" acquired by "delete_volume" :: waited 0.032s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:42 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39084ff-0733-4ae4-914e-ff00689c205c]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-344f20ef-1beb-40a3-85d9-595fbbb733fc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:42 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.info" returned: 0 in 0.570s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.418s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:42 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-344f20ef-1beb-40a3-85d9-595fbbb733fc Sep 25 10:47:42 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:42 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-45097c64-189c-41b1-8433-472ee48399f1 tempest-GroupSnapshotsV319Test-1999797305 None] group_snapshot c24491b9-fb5a-40f3-bb01-89bfee83b787: created successfully Sep 25 10:47:42 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-344f20ef-1beb-40a3-85d9-595fbbb733fc" returned: 0 in 0.479s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-344f20ef-1beb-40a3-85d9-595fbbb733fc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:42 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-344f20ef-1beb-40a3-85d9-595fbbb733fc Sep 25 10:47:42 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:42 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-344f20ef-1beb-40a3-85d9-595fbbb733fc" returned: 0 in 0.329s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Lock "cinder-quobyte-344f20ef-1beb-40a3-85d9-595fbbb733fc" released by "delete_volume" :: held 0.902s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Created reservations ['bcc5c240-2966-4f32-8ab7-1daa127b5721', '10f28ca4-3976-4a6f-91a5-973b50b0243d', 'b9fa65cf-a3ad-4865-acdb-43f5cdd5c38e', 'b704c244-de91-46cc-a473-868713dfc3b8'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:43 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:47:43 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Flow 'volume_create_manager' (2ec79f5f-99fe-4a82-8c6b-8b18c5de624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:43 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975318d5-4aa0-4cc6-becf-0607ed2afa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.655s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:43 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Deleted volume successfully. Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975318d5-4aa0-4cc6-becf-0607ed2afa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-745575465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f7759d-e3cb-4de2-9e36-d5b7c826f482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f3a3a52bdb4ac7ac8e10977ee042b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:44Z,use_quota=True,user_id='daadc5d6fc15425e9722dcb99faf215c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7b2cba-3c80-42b4-86bc-24700cf356ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7b2cba-3c80-42b4-86bc-24700cf356ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad32a55-3a27-4083-bc1b-c8ec7ef27b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad32a55-3a27-4083-bc1b-c8ec7ef27b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5f7759d-e3cb-4de2-9e36-d5b7c826f482', 'volume_name': 'volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46794b39-99d9-4267-8642-c347e85b0e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46794b39-99d9-4267-8642-c347e85b0e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644d2a22-3061-4810-9305-b9caded8b430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:43 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Volume d5f7759d-e3cb-4de2-9e36-d5b7c826f482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482', 'volume_size': 1} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-745575465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f7759d-e3cb-4de2-9e36-d5b7c826f482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f3a3a52bdb4ac7ac8e10977ee042b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:44Z,use_quota=True,user_id='daadc5d6fc15425e9722dcb99faf215c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Creating volume d5f7759d-e3cb-4de2-9e36-d5b7c826f482 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:47:44 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-05c03319-0cac-4a1a-90c2-89616cc786e7 tempest-AttachVolumeNegativeTest-950702000 None] Lock "cinder-344f20ef-1beb-40a3-85d9-595fbbb733fc-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:44 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 1073741824 Sep 25 10:47:44 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:44 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] group_snapshot c24491b9-fb5a-40f3-bb01-89bfee83b787: deleting Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] group_snapshot c24491b9-fb5a-40f3-bb01-89bfee83b787: deleting {{(pid=86874) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Acquiring lock "cinder-quobyte-9182eeff-ce74-4c7b-b5ec-b65741d4bb01" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Lock "cinder-quobyte-9182eeff-ce74-4c7b-b5ec-b65741d4bb01" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Acquiring lock "cinder-quobyte-af303cd9-64f6-4b71-8b51-b6cfc1e89267" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Lock "cinder-quobyte-af303cd9-64f6-4b71-8b51-b6cfc1e89267" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Deleting offline snapshot af303cd9-64f6-4b71-8b51-b6cfc1e89267 of volume 9182eeff-ce74-4c7b-b5ec-b65741d4bb01 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] snapshot_file for this snap is: volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9361374d-35d8-410a-a01b-34036727b96d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:44 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 Sep 25 10:47:44 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:44 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 1073741824" returned: 0 in 0.860s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:44 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 Sep 25 10:47:44 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:45 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267" returned: 0 in 0.586s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:47:45 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[043e3ec0-59ad-4f27-959e-23c995723b7f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:45 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482" returned: 0 in 0.451s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:47:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:45 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 Sep 25 10:47:45 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644d2a22-3061-4810-9305-b9caded8b430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482cd6e9-ab0f-4e79-a0b4-6ebef2d609e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:45 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Volume volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 (d5f7759d-e3cb-4de2-9e36-d5b7c826f482): created successfully Sep 25 10:47:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482cd6e9-ab0f-4e79-a0b4-6ebef2d609e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Flow 'volume_create_manager' (2ec79f5f-99fe-4a82-8c6b-8b18c5de624c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:45 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-dc1d05a2-1666-4da7-a159-ebbedd52a342 tempest-TestStampPattern-460870521 None] Created volume successfully. Sep 25 10:47:45 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01" returned: 0 in 0.574s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:45 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 Sep 25 10:47:45 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:46 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267" returned: 0 in 0.629s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:46 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267 Sep 25 10:47:46 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:46 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01.af303cd9-64f6-4b71-8b51-b6cfc1e89267" returned: 0 in 0.397s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Lock "cinder-quobyte-af303cd9-64f6-4b71-8b51-b6cfc1e89267" released by "_delete_snapshot" :: held 2.452s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Lock "cinder-quobyte-9182eeff-ce74-4c7b-b5ec-b65741d4bb01" released by "delete_snapshot" :: held 2.498s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:47 devstack cinder-volume[86874]: WARNING cinder.quota [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-761382071 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-761382071, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:47:47 devstack cinder-volume[86874]: WARNING cinder.quota [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-761382071 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-761382071, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:47:47 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] Created reservations ['ea58c13f-1373-4fb8-89cc-57f34cddffc9', 'd5a204d5-9a76-4282-b086-e1b263090b98', '76b6c4e5-64af-4a5b-bf06-ee33d007086f', 'efe66b36-9f4d-4ca1-b6e1-dc93539a869b'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:47 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-66b590eb-dd2a-4fbc-88af-65c6fc98ac07 tempest-GroupSnapshotsV319Test-1999797305 None] group_snapshot c24491b9-fb5a-40f3-bb01-89bfee83b787: deleted successfully Sep 25 10:47:48 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Acquiring lock "cinder-quobyte-9182eeff-ce74-4c7b-b5ec-b65741d4bb01" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:48 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Lock "cinder-quobyte-9182eeff-ce74-4c7b-b5ec-b65741d4bb01" acquired by "delete_volume" :: waited 0.032s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:48 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94f2628-d012-4988-9063-b06230988734]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:48 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 Sep 25 10:47:48 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:49 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01" returned: 0 in 0.688s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:49 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01 Sep 25 10:47:49 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:49 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9182eeff-ce74-4c7b-b5ec-b65741d4bb01" returned: 0 in 0.445s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Lock "cinder-quobyte-9182eeff-ce74-4c7b-b5ec-b65741d4bb01" released by "delete_volume" :: held 1.328s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:49 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=133,cinder:SELECT=139,cinder:INSERT=25,cinder:DELETE=8 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:47:49 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Created reservations ['a8d70354-b955-43fa-9349-2821bc5af155'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:49 devstack cinder-volume[86874]: WARNING cinder.quota [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-761382071 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-761382071, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:47:49 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Created reservations ['4228550a-af34-47e7-a823-64e5d12988a6', 'ab68967e-4a32-4d77-bce1-4fc4c5e32852', 'fdc39e36-75da-4e07-819b-431916083262', '2c48e28a-fdde-4677-9b22-4f6435d23222'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:50 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:47:50 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:50 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.404s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:50 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:50 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-01df57c0-9c2a-4d16-96d3-52eae8b938f9 tempest-GroupSnapshotsV319Test-1999797305 None] Delete group completed successfully. Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Flow 'volume_create_manager' (60b09301-129b-4c3b-bafb-ef03e26b3b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc2d113-d4e7-4b05-81c4-de332423a044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc2d113-d4e7-4b05-81c4-de332423a044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1798051336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e90c7c-1fba-4dc2-998e-c5868f0f2abc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='041d0afbf1dd46c0a111c2500fa3823b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:59Z,use_quota=True,user_id='15d278290d3540cd85b619e7c266baf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d79b0c5-01d7-44f7-8bf6-ae06c779cb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d79b0c5-01d7-44f7-8bf6-ae06c779cb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326de298-05a8-4530-b5b2-118a34057e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326de298-05a8-4530-b5b2-118a34057e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e90c7c-1fba-4dc2-998e-c5868f0f2abc', 'volume_name': 'volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb80e85b-4f1f-4bd9-af1f-0d304ad9b4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb80e85b-4f1f-4bd9-af1f-0d304ad9b4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5780ff6-f187-4398-8778-b7d6d675425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:59 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Volume 69e90c7c-1fba-4dc2-998e-c5868f0f2abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc', 'volume_size': 1} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1798051336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e90c7c-1fba-4dc2-998e-c5868f0f2abc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='041d0afbf1dd46c0a111c2500fa3823b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:59Z,use_quota=True,user_id='15d278290d3540cd85b619e7c266baf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Creating volume 69e90c7c-1fba-4dc2-998e-c5868f0f2abc {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:47:59 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:47:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:59 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc 1073741824 Sep 25 10:47:59 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:00 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc 1073741824" returned: 0 in 1.028s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:00 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc Sep 25 10:48:00 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:00 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc" returned: 0 in 0.395s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:48:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5780ff6-f187-4398-8778-b7d6d675425d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6a43ad-2279-4b6c-b41d-e90c1ed1134f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:01 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Volume volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc (69e90c7c-1fba-4dc2-998e-c5868f0f2abc): created successfully Sep 25 10:48:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6a43ad-2279-4b6c-b41d-e90c1ed1134f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Flow 'volume_create_manager' (60b09301-129b-4c3b-bafb-ef03e26b3b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:01 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-e891ee68-4029-4c06-be4b-f319b3cbb26d req-32797860-3f67-417a-a377-9f159d1be6c6 tempest-VolumesGetTestJSON-2083382959 None] Created volume successfully. Sep 25 10:48:02 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Acquiring lock "cinder-69e90c7c-1fba-4dc2-998e-c5868f0f2abc-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:02 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Lock "cinder-69e90c7c-1fba-4dc2-998e-c5868f0f2abc-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:02 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Acquiring lock "cinder-quobyte-69e90c7c-1fba-4dc2-998e-c5868f0f2abc" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:02 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Lock "cinder-quobyte-69e90c7c-1fba-4dc2-998e-c5868f0f2abc" acquired by "delete_volume" :: waited 0.038s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:02 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8ad797-32ac-45bc-8ca2-5b38f132d2ff]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:03 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc Sep 25 10:48:03 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:03 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc" returned: 0 in 0.675s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:03 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc Sep 25 10:48:03 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:04 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-69e90c7c-1fba-4dc2-998e-c5868f0f2abc" returned: 0 in 0.515s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Lock "cinder-quobyte-69e90c7c-1fba-4dc2-998e-c5868f0f2abc" released by "delete_volume" :: held 1.299s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:04 devstack cinder-volume[86874]: DEBUG cinder.quota [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Created reservations ['9693a86f-242c-41f6-a738-28362386bba2', 'f3323cf3-6c3e-4a6b-a3f7-5aa1535082e2', '6676da36-66f5-4164-b265-5cdee79d6f1d', 'bf3e77ea-4ece-4710-be9b-bd9fd445ba55'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:04 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:04 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:04 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:48:04 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:04 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.480s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:04 devstack cinder-volume[86874]: DEBUG cinder.manager [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:48:04 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Deleted volume successfully. Sep 25 10:48:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-bfae6145-7655-4522-8147-ec8dd4d71053 req-d4ddbb84-085b-419d-9e6b-e2c162566461 tempest-VolumesGetTestJSON-2083382959 None] Lock "cinder-69e90c7c-1fba-4dc2-998e-c5868f0f2abc-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:06 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-eef83b5b-2066-401f-a1e8-f0774dafb657 tempest-GroupsV314Test-1170372670 None] Group tempest-GroupsV314Test-Group-1636368196: creating Sep 25 10:48:06 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-eef83b5b-2066-401f-a1e8-f0774dafb657 tempest-GroupsV314Test-1170372670 None] Group tempest-GroupsV314Test-Group-1636368196: created successfully Sep 25 10:48:06 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-eef83b5b-2066-401f-a1e8-f0774dafb657 tempest-GroupsV314Test-1170372670 None] Create group completed successfully. Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Flow 'volume_create_manager' (dcb3c119-85dd-408d-ad83-f8a6e7138ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d05c8c-3e76-4c21-b488-7da315d76a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d05c8c-3e76-4c21-b488-7da315d76a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1600395390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=20a2d33b-c005-47fd-93bf-6748e36fc1cd,host='devstack@QuobyteHD#QuobyteHD',id=79b453ea-e288-4350-9336-d5c015e5b06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9c2d2baa6c43afaeabcb1c5ca62a11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:08Z,use_quota=True,user_id='fa77ad507d2545cf9cfd42b7392cb1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88dd5e2-4422-4a7e-8b76-599cd9001db9),volume_type_id=b88dd5e2-4422-4a7e-8b76-599cd9001db9)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1470a4ae-9a57-45d9-866a-fd3ff811842a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1470a4ae-9a57-45d9-866a-fd3ff811842a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6984047c-b3b5-4f2f-b620-7efeeb882d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6984047c-b3b5-4f2f-b620-7efeeb882d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79b453ea-e288-4350-9336-d5c015e5b06b', 'volume_name': 'volume-79b453ea-e288-4350-9336-d5c015e5b06b', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940283aa-4278-47a4-aa25-d96e616cd0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940283aa-4278-47a4-aa25-d96e616cd0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9495a479-98c1-4b7d-b815-88cb49bbcee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:08 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Volume 79b453ea-e288-4350-9336-d5c015e5b06b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79b453ea-e288-4350-9336-d5c015e5b06b', 'volume_size': 1} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=20a2d33b-c005-47fd-93bf-6748e36fc1cd,created_at=2026-09-25T08:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1600395390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=20a2d33b-c005-47fd-93bf-6748e36fc1cd,host='devstack@QuobyteHD#QuobyteHD',id=79b453ea-e288-4350-9336-d5c015e5b06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9c2d2baa6c43afaeabcb1c5ca62a11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:08Z,use_quota=True,user_id='fa77ad507d2545cf9cfd42b7392cb1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88dd5e2-4422-4a7e-8b76-599cd9001db9),volume_type_id=b88dd5e2-4422-4a7e-8b76-599cd9001db9)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Creating volume 79b453ea-e288-4350-9336-d5c015e5b06b {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:48:08 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:48:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:08 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b 1073741824 Sep 25 10:48:08 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:09 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b 1073741824" returned: 0 in 0.745s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:09 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b Sep 25 10:48:09 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:10 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b" returned: 0 in 0.516s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:10 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:48:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9495a479-98c1-4b7d-b815-88cb49bbcee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b453ea-e288-4350-9336-d5c015e5b06b', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b405201-4e66-42c0-bc00-5f9df0b5d694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:10 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Volume volume-79b453ea-e288-4350-9336-d5c015e5b06b (79b453ea-e288-4350-9336-d5c015e5b06b): created successfully Sep 25 10:48:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b405201-4e66-42c0-bc00-5f9df0b5d694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Flow 'volume_create_manager' (dcb3c119-85dd-408d-ad83-f8a6e7138ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:10 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-85d5a29b-9ebb-4878-8bb0-0c0569395926 tempest-GroupsV314Test-1170372670 None] Created volume successfully. Sep 25 10:48:11 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=117,cinder:INSERT=32,cinder:SELECT=101,cinder:DELETE=5 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:48:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:12 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Cloning volume 79b453ea-e288-4350-9336-d5c015e5b06b to volume 41de14db-3cdc-4c08-bdb9-1bfa74c22d03 Sep 25 10:48:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Creating offline snapshot 60d67e7f-19d8-493e-9869-15ce979bd6d0 of volume 79b453ea-e288-4350-9336-d5c015e5b06b {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:48:12 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[62320014-27c9-46aa-be57-2f5aeda61fd7]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:12 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b Sep 25 10:48:12 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:12 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b" returned: 0 in 0.615s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:12 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 1G Sep 25 10:48:12 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:13 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 1G" returned: 0 in 0.582s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b453ea-e288-4350-9336-d5c015e5b06b -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:13 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b453ea-e288-4350-9336-d5c015e5b06b -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 Sep 25 10:48:13 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:13 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b453ea-e288-4350-9336-d5c015e5b06b -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0" returned: 0 in 0.435s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:13 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:48:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:13 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 Sep 25 10:48:13 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:14 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0" returned: 0 in 0.342s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:14 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.info Sep 25 10:48:14 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:14 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.info" returned: 0 in 0.341s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:14 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:14 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.info Sep 25 10:48:14 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:14 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.info" returned: 0 in 0.312s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Acquiring lock "cinder-quobyte-41de14db-3cdc-4c08-bdb9-1bfa74c22d03" by "_copy_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Lock "cinder-quobyte-41de14db-3cdc-4c08-bdb9-1bfa74c22d03" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] snapshot: 60d67e7f-19d8-493e-9869-15ce979bd6d0, volume: 41de14db-3cdc-4c08-bdb9-1bfa74c22d03, {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[885bf010-8bc2-453a-b717-3322ed6b56f6]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:15 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 Sep 25 10:48:15 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:15 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0" returned: 0 in 0.522s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79b453ea-e288-4350-9336-d5c015e5b06b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[034fbff4-905b-44aa-ab2e-c0981f6ef3a9]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:15 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b Sep 25 10:48:15 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Flow 'volume_create_manager' (822abe4e-cd87-4230-acef-a9d417d93759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bfc052-310e-4d5f-a770-6a079bde942f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bfc052-310e-4d5f-a770-6a079bde942f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-991987074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8657934f-6036-40ce-a610-ef78ead09153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f88bd1f2d4213850517f88c17da65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:16Z,use_quota=True,user_id='2ecdb56c3a124949ac516f702f76b265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcd6f6b-8fdc-4f36-b630-7578a4c66d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcd6f6b-8fdc-4f36-b630-7578a4c66d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519e5186-fd72-4f59-b06a-cf3283559f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519e5186-fd72-4f59-b06a-cf3283559f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8657934f-6036-40ce-a610-ef78ead09153', 'volume_name': 'volume-8657934f-6036-40ce-a610-ef78ead09153', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc00437-39cb-4d58-83a2-fd00de6a07f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc00437-39cb-4d58-83a2-fd00de6a07f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c9e88f-6252-4b6c-9a23-1456c613c44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:15 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Volume 8657934f-6036-40ce-a610-ef78ead09153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8657934f-6036-40ce-a610-ef78ead09153', 'volume_size': 1} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:15 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b" returned: 0 in 0.464s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] will copy from snapshot at /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Creating direct copy from snapshot {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG cinder.utils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Path /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03 not found in is_blk_device check {{(pid=86874) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 10:48:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:15 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03 Sep 25 10:48:15 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bdd7676b-24af-4d76-a3ce-0efa7d1ca6f6 tempest-GroupsTest-526961660 None] Group tempest-Group1-1644650228: creating Sep 25 10:48:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bdd7676b-24af-4d76-a3ce-0efa7d1ca6f6 tempest-GroupsTest-526961660 None] Group tempest-Group1-1644650228: created successfully Sep 25 10:48:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bdd7676b-24af-4d76-a3ce-0efa7d1ca6f6 tempest-GroupsTest-526961660 None] Create group completed successfully. Sep 25 10:48:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5719ca76-35c8-4054-9332-704a0b455ec1 tempest-GroupsTest-526961660 None] Group tempest-Group2-726202794: creating Sep 25 10:48:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5719ca76-35c8-4054-9332-704a0b455ec1 tempest-GroupsTest-526961660 None] Group tempest-Group2-726202794: created successfully Sep 25 10:48:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5719ca76-35c8-4054-9332-704a0b455ec1 tempest-GroupsTest-526961660 None] Create group completed successfully. Sep 25 10:48:20 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Flow 'volume_create_manager' (f534970d-123d-4cfd-be66-5e0f99d5ab8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3dae605-b55c-4243-a44a-fcf24702c459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3dae605-b55c-4243-a44a-fcf24702c459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2133106094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=75d1f294-ef1f-4ca2-bf62-5a8b3f0dd4e7,host='devstack@QuobyteHD#QuobyteHD',id=b52f17da-8a99-407d-ab52-f7eeb053e1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b997dcc4a304b03ab0c3b047377d235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:20Z,use_quota=True,user_id='5db62e8cd39f45f18a6d6f5f731618b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06a86336-cd8c-4838-8acf-779c07c964af),volume_type_id=06a86336-cd8c-4838-8acf-779c07c964af)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4a8dc6-7916-4179-8469-f982a18ff546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4a8dc6-7916-4179-8469-f982a18ff546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882d05ab-4de9-4dc0-ab13-bed0c39a5d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882d05ab-4de9-4dc0-ab13-bed0c39a5d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b52f17da-8a99-407d-ab52-f7eeb053e1c5', 'volume_name': 'volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c576a640-0719-4035-8b05-8d5b60966968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c576a640-0719-4035-8b05-8d5b60966968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6894c83-4edb-4c3d-aa38-551c4af4763c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:20 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Volume b52f17da-8a99-407d-ab52-f7eeb053e1c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5', 'volume_size': 1} Sep 25 10:48:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-13616f2d-3935-423a-9bfd-3fd796fafaa5 req-444820e6-eaf1-4771-a956-f8771dd8abd4 tempest-TestStampPattern-460870521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:23 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03" returned: 0 in 7.984s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:23 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b, size 1024.00 MB, duration 7.99 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:48:23 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Converted 1024.00 MB image at 128.24 MB/s Sep 25 10:48:23 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:48:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:23 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03 Sep 25 10:48:23 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:24 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03" returned: 0 in 0.272s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Lock "cinder-quobyte-41de14db-3cdc-4c08-bdb9-1bfa74c22d03" released by "_copy_volume_from_snapshot" :: held 9.361s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Acquiring lock "cinder-quobyte-60d67e7f-19d8-493e-9869-15ce979bd6d0" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Lock "cinder-quobyte-60d67e7f-19d8-493e-9869-15ce979bd6d0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Deleting offline snapshot 60d67e7f-19d8-493e-9869-15ce979bd6d0 of volume 79b453ea-e288-4350-9336-d5c015e5b06b {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:48:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] snapshot_file for this snap is: volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:48:24 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4ff617-fa0f-499f-b39b-35b20aa3a3c0]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:24 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 Sep 25 10:48:24 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:24 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0" returned: 0 in 0.417s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79b453ea-e288-4350-9336-d5c015e5b06b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:48:24 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8056fb53-0167-4eb5-8b9d-ccec32d03ebc]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:24 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b Sep 25 10:48:24 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:25 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b" returned: 0 in 0.599s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:25 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 Sep 25 10:48:25 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:25 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0" returned: 0 in 0.493s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:25 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0 Sep 25 10:48:25 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:26 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:48:26 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:26 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b.60d67e7f-19d8-493e-9869-15ce979bd6d0" returned: 0 in 0.340s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Lock "cinder-quobyte-60d67e7f-19d8-493e-9869-15ce979bd6d0" released by "_delete_snapshot" :: held 1.988s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.252s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.546s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-991987074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8657934f-6036-40ce-a610-ef78ead09153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f88bd1f2d4213850517f88c17da65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:16Z,use_quota=True,user_id='2ecdb56c3a124949ac516f702f76b265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Creating volume 8657934f-6036-40ce-a610-ef78ead09153 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:48:26 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8657934f-6036-40ce-a610-ef78ead09153 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:26 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8657934f-6036-40ce-a610-ef78ead09153 1073741824 Sep 25 10:48:26 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:26 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6bd8e78c-7409-42ae-841f-8ae880d23e4d tempest-GroupsV314Test-1170372670 None] Create group from source-group-20a2d33b-c005-47fd-93bf-6748e36fc1cd completed successfully. Sep 25 10:48:26 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.351s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:48:26 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8657934f-6036-40ce-a610-ef78ead09153 1073741824" returned: 0 in 0.609s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8657934f-6036-40ce-a610-ef78ead09153 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:26 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8657934f-6036-40ce-a610-ef78ead09153 Sep 25 10:48:26 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:27 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8657934f-6036-40ce-a610-ef78ead09153" returned: 0 in 0.326s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.647s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=75d1f294-ef1f-4ca2-bf62-5a8b3f0dd4e7,created_at=2026-09-25T08:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2133106094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=75d1f294-ef1f-4ca2-bf62-5a8b3f0dd4e7,host='devstack@QuobyteHD#QuobyteHD',id=b52f17da-8a99-407d-ab52-f7eeb053e1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b997dcc4a304b03ab0c3b047377d235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:20Z,use_quota=True,user_id='5db62e8cd39f45f18a6d6f5f731618b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06a86336-cd8c-4838-8acf-779c07c964af),volume_type_id=06a86336-cd8c-4838-8acf-779c07c964af)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Creating volume b52f17da-8a99-407d-ab52-f7eeb053e1c5 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:48:27 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c9e88f-6252-4b6c-9a23-1456c613c44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8657934f-6036-40ce-a610-ef78ead09153', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7186de73-8fbb-4308-a4ab-b12d090db6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:27 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5 1073741824 Sep 25 10:48:27 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:27 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Volume volume-8657934f-6036-40ce-a610-ef78ead09153 (8657934f-6036-40ce-a610-ef78ead09153): created successfully Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7186de73-8fbb-4308-a4ab-b12d090db6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Flow 'volume_create_manager' (822abe4e-cd87-4230-acef-a9d417d93759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:27 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-166bbc77-1bf7-4ff6-9821-f0f46253f2f1 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Created volume successfully. Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Acquiring lock "cinder-quobyte-41de14db-3cdc-4c08-bdb9-1bfa74c22d03" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Lock "cinder-quobyte-41de14db-3cdc-4c08-bdb9-1bfa74c22d03" acquired by "delete_volume" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa60d19-05d5-4718-b5a3-86c0bd6c3349]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:27 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03 Sep 25 10:48:27 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:27 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5 1073741824" returned: 0 in 0.623s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:28 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5 Sep 25 10:48:28 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:28 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03" returned: 0 in 0.512s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:28 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03 Sep 25 10:48:28 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:28 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Acquiring lock "cinder-8657934f-6036-40ce-a610-ef78ead09153-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5" returned: 0 in 0.366s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-13616f2d-3935-423a-9bfd-3fd796fafaa5 req-444820e6-eaf1-4771-a956-f8771dd8abd4 tempest-TestStampPattern-460870521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.095s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6894c83-4edb-4c3d-aa38-551c4af4763c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:28 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c03e8e-c569-4239-ac06-18c4b781a411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Lock "cinder-8657934f-6036-40ce-a610-ef78ead09153-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-13616f2d-3935-423a-9bfd-3fd796fafaa5 req-444820e6-eaf1-4771-a956-f8771dd8abd4 tempest-TestStampPattern-460870521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-41de14db-3cdc-4c08-bdb9-1bfa74c22d03" returned: 0 in 0.361s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:28 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Volume volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5 (b52f17da-8a99-407d-ab52-f7eeb053e1c5): created successfully Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c03e8e-c569-4239-ac06-18c4b781a411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Flow 'volume_create_manager' (f534970d-123d-4cfd-be66-5e0f99d5ab8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Lock "cinder-quobyte-41de14db-3cdc-4c08-bdb9-1bfa74c22d03" released by "delete_volume" :: held 0.972s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:28 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4b4ef287-fa34-4fbc-9f10-46ec42430b29 tempest-GroupsTest-526961660 None] Created volume successfully. Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Acquiring lock "cinder-quobyte-8657934f-6036-40ce-a610-ef78ead09153" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-13616f2d-3935-423a-9bfd-3fd796fafaa5 req-444820e6-eaf1-4771-a956-f8771dd8abd4 tempest-TestStampPattern-460870521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '995a8fed-c1de-4221-8bb1-716d732573fa', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Lock "cinder-quobyte-8657934f-6036-40ce-a610-ef78ead09153" acquired by "delete_volume" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[011dce55-0a59-4220-8f74-3d4823244bd1]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8657934f-6036-40ce-a610-ef78ead09153 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Created reservations ['6c6663ae-ded1-4288-a604-9f6fa156d61e'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:28 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-13616f2d-3935-423a-9bfd-3fd796fafaa5 req-444820e6-eaf1-4771-a956-f8771dd8abd4 tempest-TestStampPattern-460870521 None] attachment_update completed successfully. Sep 25 10:48:28 devstack cinder-volume[86874]: WARNING cinder.quota [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1903754091 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1903754091, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:48:28 devstack cinder-volume[86874]: WARNING cinder.quota [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1903754091 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1903754091, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Created reservations ['50c51d4f-95f7-470f-96b7-872b47fa667f', '33f070a2-a5f4-4aa8-a35e-9dc0ac79aa4b', '95b777ec-4396-400e-aa11-534ba5631a47', '81f5170d-0948-49c2-a37d-9470d251f332'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:28 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8657934f-6036-40ce-a610-ef78ead09153 Sep 25 10:48:28 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:28 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:48:28 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:29 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8657934f-6036-40ce-a610-ef78ead09153" returned: 0 in 0.617s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8657934f-6036-40ce-a610-ef78ead09153 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:29 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8657934f-6036-40ce-a610-ef78ead09153 Sep 25 10:48:29 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:29 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.342s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:29 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:48:29 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-48f3288f-4e70-44e1-9414-bd3487c9e536 tempest-GroupsV314Test-1170372670 None] Delete group completed successfully. Sep 25 10:48:29 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8657934f-6036-40ce-a610-ef78ead09153" returned: 0 in 0.364s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Lock "cinder-quobyte-8657934f-6036-40ce-a610-ef78ead09153" released by "delete_volume" :: held 1.043s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:29 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Created reservations ['e62dc12a-c0db-4527-989d-518e5a264fb9', '0110a40c-53ac-43db-9f9f-7717de8ecdd0', '30bb71bb-dbbe-4224-88c8-2647af21e9f8', '9b127089-1a05-49f5-a4f9-6efc782c8bfa'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:29 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:48:29 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:30 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.438s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:30 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:48:30 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Deleted volume successfully. Sep 25 10:48:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Acquiring lock "cinder-quobyte-b52f17da-8a99-407d-ab52-f7eeb053e1c5" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-da7f8336-52af-456b-9a38-ef71f1cb3278 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Lock "cinder-8657934f-6036-40ce-a610-ef78ead09153-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Lock "cinder-quobyte-b52f17da-8a99-407d-ab52-f7eeb053e1c5" acquired by "delete_volume" :: waited 0.041s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:30 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6167d8e-aa72-4c65-8ca1-356facd29c31]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Acquiring lock "cinder-quobyte-79b453ea-e288-4350-9336-d5c015e5b06b" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Lock "cinder-quobyte-79b453ea-e288-4350-9336-d5c015e5b06b" acquired by "delete_volume" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:30 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcf166b-8677-436b-a8be-494732e0460a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:30 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5 Sep 25 10:48:30 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:30 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b Sep 25 10:48:30 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:30 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5" returned: 0 in 0.504s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:30 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5 Sep 25 10:48:30 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:31 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b" returned: 0 in 0.548s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:31 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b Sep 25 10:48:31 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:31 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b52f17da-8a99-407d-ab52-f7eeb053e1c5" returned: 0 in 0.358s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Lock "cinder-quobyte-b52f17da-8a99-407d-ab52-f7eeb053e1c5" released by "delete_volume" :: held 0.935s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Flow 'volume_create_manager' (04d4bb4f-2a69-4d43-8431-fbafffba067a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:31 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc0180e-e8c4-47f0-9d06-943fd6558ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-79b453ea-e288-4350-9336-d5c015e5b06b" returned: 0 in 0.352s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc0180e-e8c4-47f0-9d06-943fd6558ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1645558908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6074e19b-76e1-43e0-a846-d08edc24ef23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f88bd1f2d4213850517f88c17da65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:31Z,use_quota=True,user_id='2ecdb56c3a124949ac516f702f76b265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9a0904-e4cd-4f13-9b1a-a6d715fc7f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9a0904-e4cd-4f13-9b1a-a6d715fc7f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f391328a-b7eb-4271-a300-b3f88f811d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f391328a-b7eb-4271-a300-b3f88f811d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6074e19b-76e1-43e0-a846-d08edc24ef23', 'volume_name': 'volume-6074e19b-76e1-43e0-a846-d08edc24ef23', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee907f8-b523-4fad-a288-9da85ae3d0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee907f8-b523-4fad-a288-9da85ae3d0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b512eb-2b92-44ab-b163-fef6c1ad3fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:31 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Volume 6074e19b-76e1-43e0-a846-d08edc24ef23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6074e19b-76e1-43e0-a846-d08edc24ef23', 'volume_size': 1} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1645558908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6074e19b-76e1-43e0-a846-d08edc24ef23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39f88bd1f2d4213850517f88c17da65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:31Z,use_quota=True,user_id='2ecdb56c3a124949ac516f702f76b265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Creating volume 6074e19b-76e1-43e0-a846-d08edc24ef23 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:48:31 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6074e19b-76e1-43e0-a846-d08edc24ef23 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Lock "cinder-quobyte-79b453ea-e288-4350-9336-d5c015e5b06b" released by "delete_volume" :: held 1.066s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:31 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6074e19b-76e1-43e0-a846-d08edc24ef23 1073741824 Sep 25 10:48:31 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Created reservations ['b7857c8a-4941-47d6-a593-9ada875798b7'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:31 devstack cinder-volume[86874]: WARNING cinder.quota [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1448555418 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1448555418, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:48:31 devstack cinder-volume[86874]: WARNING cinder.quota [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1448555418 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1448555418, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Created reservations ['20387c70-56d5-4815-ab85-7508db962997'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Created reservations ['6c52bef2-0a54-4809-97a4-85bb103ca864', '6f353823-c66c-4520-b30f-d216477f8540', 'ff08b4cc-4799-458a-8715-0a6d5881325c', '308f61da-f8a8-4453-b96d-9d1922307b17'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Created reservations ['8687b5ff-535b-4249-9d4a-04de51dc8ae7', '57320b0e-0908-48a2-837f-87db2946a279', '397e5eb6-6aeb-45f3-85c2-80a40ec40447', 'd38748a0-3f14-4d16-8eb5-ffe2fe20cf5a'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:31 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:48:31 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:32 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:48:32 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:32 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.384s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:32 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6074e19b-76e1-43e0-a846-d08edc24ef23 1073741824" returned: 0 in 0.752s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:32 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-245396cc-ba2c-4c57-80eb-c3930cfa8488 tempest-GroupsTest-526961660 None] Delete group completed successfully. Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6074e19b-76e1-43e0-a846-d08edc24ef23 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:32 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6074e19b-76e1-43e0-a846-d08edc24ef23 Sep 25 10:48:32 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:32 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.424s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:48:32 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2aeb42da-599f-4c28-85af-2323b4d8422f tempest-GroupsV314Test-1170372670 None] Delete group completed successfully. Sep 25 10:48:32 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6074e19b-76e1-43e0-a846-d08edc24ef23" returned: 0 in 0.307s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b512eb-2b92-44ab-b163-fef6c1ad3fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6074e19b-76e1-43e0-a846-d08edc24ef23', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b094bb-8525-4281-8aab-8858b55acfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:32 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Volume volume-6074e19b-76e1-43e0-a846-d08edc24ef23 (6074e19b-76e1-43e0-a846-d08edc24ef23): created successfully Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b094bb-8525-4281-8aab-8858b55acfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Flow 'volume_create_manager' (04d4bb4f-2a69-4d43-8431-fbafffba067a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:32 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-962a9088-243c-41ec-b85f-6f0bf5f0fa59 tempest-VolumeQuotasAdminTestJSON-1393736029 None] Created volume successfully. Sep 25 10:48:33 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-a60faf2d-5205-47f8-8329-a195ae0a36fe tempest-GroupsTest-526961660 None] Created reservations ['e3dc7a76-c010-4131-a8d6-8cc48493ad9f'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a60faf2d-5205-47f8-8329-a195ae0a36fe tempest-GroupsTest-526961660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a60faf2d-5205-47f8-8329-a195ae0a36fe tempest-GroupsTest-526961660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a60faf2d-5205-47f8-8329-a195ae0a36fe tempest-GroupsTest-526961660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a60faf2d-5205-47f8-8329-a195ae0a36fe tempest-GroupsTest-526961660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a60faf2d-5205-47f8-8329-a195ae0a36fe tempest-GroupsTest-526961660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a60faf2d-5205-47f8-8329-a195ae0a36fe tempest-GroupsTest-526961660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:33 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:48:33 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:33 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a60faf2d-5205-47f8-8329-a195ae0a36fe tempest-GroupsTest-526961660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.467s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:33 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-a60faf2d-5205-47f8-8329-a195ae0a36fe tempest-GroupsTest-526961660 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:48:33 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a60faf2d-5205-47f8-8329-a195ae0a36fe tempest-GroupsTest-526961660 None] Delete group completed successfully. Sep 25 10:48:34 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-77855dbf-ca7d-4586-ad35-90144085b4ff tempest-VolumeQuotasAdminTestJSON-1862202278 None] Transfer volume completed successfully. Sep 25 10:48:35 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d636cf1c-67a5-4a6a-8557-d06bd222ad14 tempest-GroupsTest-526961660 None] Group tempest-GroupsTest-Group-1729349344: creating Sep 25 10:48:35 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d636cf1c-67a5-4a6a-8557-d06bd222ad14 tempest-GroupsTest-526961660 None] Group tempest-GroupsTest-Group-1729349344: created successfully Sep 25 10:48:35 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d636cf1c-67a5-4a6a-8557-d06bd222ad14 tempest-GroupsTest-526961660 None] Create group completed successfully. Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Acquiring lock "cinder-6074e19b-76e1-43e0-a846-d08edc24ef23-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Lock "cinder-6074e19b-76e1-43e0-a846-d08edc24ef23-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Acquiring lock "cinder-quobyte-6074e19b-76e1-43e0-a846-d08edc24ef23" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Lock "cinder-quobyte-6074e19b-76e1-43e0-a846-d08edc24ef23" acquired by "delete_volume" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0c4311-a1b8-4b1e-a097-4927f5d0c31d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6074e19b-76e1-43e0-a846-d08edc24ef23 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Flow 'volume_create_manager' (030f7752-509a-4282-8be6-98c63f8a5832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdabfb72-9dac-43ef-97c5-d82b8636fd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdabfb72-9dac-43ef-97c5-d82b8636fd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1833764264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34b193e1-0f0a-4068-bc11-7e8f8f70bd09,host='devstack@QuobyteHD#QuobyteHD',id=3690bb83-5f7b-4f8d-97a1-9207587ead8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b997dcc4a304b03ab0c3b047377d235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:36Z,use_quota=True,user_id='5db62e8cd39f45f18a6d6f5f731618b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9549cf0-97d1-473d-af84-038fca99e278),volume_type_id=f9549cf0-97d1-473d-af84-038fca99e278)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2084cf58-5429-4d80-8b1e-976033e2fdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2084cf58-5429-4d80-8b1e-976033e2fdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab640e3e-3eba-4e71-bd95-afe0d127ec3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab640e3e-3eba-4e71-bd95-afe0d127ec3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3690bb83-5f7b-4f8d-97a1-9207587ead8e', 'volume_name': 'volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71401deb-062d-4b16-990a-7f989117f66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71401deb-062d-4b16-990a-7f989117f66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7f5594-1c77-4d19-8240-0ac3ef84c101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:36 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Volume 3690bb83-5f7b-4f8d-97a1-9207587ead8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e', 'volume_size': 1} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=34b193e1-0f0a-4068-bc11-7e8f8f70bd09,created_at=2026-09-25T08:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1833764264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34b193e1-0f0a-4068-bc11-7e8f8f70bd09,host='devstack@QuobyteHD#QuobyteHD',id=3690bb83-5f7b-4f8d-97a1-9207587ead8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b997dcc4a304b03ab0c3b047377d235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:36Z,use_quota=True,user_id='5db62e8cd39f45f18a6d6f5f731618b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9549cf0-97d1-473d-af84-038fca99e278),volume_type_id=f9549cf0-97d1-473d-af84-038fca99e278)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Creating volume 3690bb83-5f7b-4f8d-97a1-9207587ead8e {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:48:36 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:36 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6074e19b-76e1-43e0-a846-d08edc24ef23 Sep 25 10:48:36 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:36 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e 1073741824 Sep 25 10:48:36 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:36 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-d0e5bff8-7444-40ec-b41d-03241b6ab61d req-e7dcc36d-e521-4782-8ec4-139356436ef8 tempest-TestStampPattern-460870521 None] Terminate volume connection completed successfully. Sep 25 10:48:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-d0e5bff8-7444-40ec-b41d-03241b6ab61d req-e7dcc36d-e521-4782-8ec4-139356436ef8 tempest-TestStampPattern-460870521 None] Deleting attachment 995a8fed-c1de-4221-8bb1-716d732573fa. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:48:37 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6074e19b-76e1-43e0-a846-d08edc24ef23" returned: 0 in 0.695s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6074e19b-76e1-43e0-a846-d08edc24ef23 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:37 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6074e19b-76e1-43e0-a846-d08edc24ef23 Sep 25 10:48:37 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:37 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e 1073741824" returned: 0 in 0.819s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:37 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e Sep 25 10:48:37 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:37 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6074e19b-76e1-43e0-a846-d08edc24ef23" returned: 0 in 0.421s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Lock "cinder-quobyte-6074e19b-76e1-43e0-a846-d08edc24ef23" released by "delete_volume" :: held 1.211s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Created reservations ['5201b7d0-7f2a-4342-b35b-30962c160d8e', '50239fe5-8eb1-4139-9ad7-8d8fb7db9fac', 'c0eccf76-87c0-4aab-86b8-a0e68309e7b3', '06438dc4-bd52-479c-984c-2b3ceca91700'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:37 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e" returned: 0 in 0.419s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7f5594-1c77-4d19-8240-0ac3ef84c101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:37 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:48:37 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070142c0-a887-4929-8137-43ea0f4d7419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:37 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Volume volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e (3690bb83-5f7b-4f8d-97a1-9207587ead8e): created successfully Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070142c0-a887-4929-8137-43ea0f4d7419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Flow 'volume_create_manager' (030f7752-509a-4282-8be6-98c63f8a5832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:37 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-144cb613-0f86-42ee-8d49-7952eb74ce46 tempest-GroupsTest-526961660 None] Created volume successfully. Sep 25 10:48:38 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.486s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:38 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:48:38 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Deleted volume successfully. Sep 25 10:48:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dd57003d-baf8-4b66-94e8-88b979703b31 tempest-VolumeQuotasAdminTestJSON-827886172 None] Lock "cinder-6074e19b-76e1-43e0-a846-d08edc24ef23-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] Creating offline snapshot 60e07bc6-ffbd-4263-b369-e27cc529feec of volume d5f7759d-e3cb-4de2-9e36-d5b7c826f482 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:48:38 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c852bfd-03a7-4b7d-bc34-c982999182af]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:38 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 Sep 25 10:48:38 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:39 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482" returned: 0 in 0.601s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:39 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec 1G Sep 25 10:48:39 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:39 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Flow 'volume_create_manager' (1e7a355f-00bf-49d2-a031-9df0e3acd097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfdcc73-3012-419a-8a6a-1de65d8bbd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:39 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfdcc73-3012-419a-8a6a-1de65d8bbd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1588142769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34b193e1-0f0a-4068-bc11-7e8f8f70bd09,host='devstack@QuobyteHD#QuobyteHD',id=1631ff58-518c-4620-a938-4063665667ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b997dcc4a304b03ab0c3b047377d235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:40Z,use_quota=True,user_id='5db62e8cd39f45f18a6d6f5f731618b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9549cf0-97d1-473d-af84-038fca99e278),volume_type_id=f9549cf0-97d1-473d-af84-038fca99e278)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60389db-14a8-4670-aafe-7a7c1d0480af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60389db-14a8-4670-aafe-7a7c1d0480af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b9d2d6-04be-4b4b-a4f3-22330a5718c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b9d2d6-04be-4b4b-a4f3-22330a5718c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1631ff58-518c-4620-a938-4063665667ce', 'volume_name': 'volume-1631ff58-518c-4620-a938-4063665667ce', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4122f6f-bf13-4f3e-9be5-d6d9ca7b5ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4122f6f-bf13-4f3e-9be5-d6d9ca7b5ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8255fb8f-ac5d-4772-96cb-1ad293c2427f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:40 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Volume 1631ff58-518c-4620-a938-4063665667ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1631ff58-518c-4620-a938-4063665667ce', 'volume_size': 1} Sep 25 10:48:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec 1G" returned: 0 in 0.783s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:40 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec Sep 25 10:48:40 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:40 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec" returned: 0 in 0.420s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:40 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec is being set with open permissions: ugo+rw Sep 25 10:48:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:40 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec Sep 25 10:48:40 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:40 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec" returned: 0 in 0.379s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:40 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.info Sep 25 10:48:40 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:41 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.info" returned: 0 in 0.354s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:41 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.info is being set with open permissions: ugo+rw Sep 25 10:48:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:41 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.info Sep 25 10:48:41 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:41 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.info" returned: 0 in 0.346s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.027s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=34b193e1-0f0a-4068-bc11-7e8f8f70bd09,created_at=2026-09-25T08:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1588142769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34b193e1-0f0a-4068-bc11-7e8f8f70bd09,host='devstack@QuobyteHD#QuobyteHD',id=1631ff58-518c-4620-a938-4063665667ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b997dcc4a304b03ab0c3b047377d235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:40Z,use_quota=True,user_id='5db62e8cd39f45f18a6d6f5f731618b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9549cf0-97d1-473d-af84-038fca99e278),volume_type_id=f9549cf0-97d1-473d-af84-038fca99e278)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:48:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Creating volume 1631ff58-518c-4620-a938-4063665667ce {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:48:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:48:41 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:48:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1631ff58-518c-4620-a938-4063665667ce 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:41 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1631ff58-518c-4620-a938-4063665667ce 1073741824 Sep 25 10:48:41 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:41 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7eacb01f-8919-4a26-a1d0-3389d1940811 tempest-TestStampPattern-460870521 None] Create snapshot completed successfully Sep 25 10:48:42 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1631ff58-518c-4620-a938-4063665667ce 1073741824" returned: 0 in 0.782s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1631ff58-518c-4620-a938-4063665667ce {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:42 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1631ff58-518c-4620-a938-4063665667ce Sep 25 10:48:42 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:42 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1631ff58-518c-4620-a938-4063665667ce" returned: 0 in 0.448s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:48:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8255fb8f-ac5d-4772-96cb-1ad293c2427f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1631ff58-518c-4620-a938-4063665667ce', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01cabdb-8d47-4b73-9b41-eed2e45ae8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:42 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Volume volume-1631ff58-518c-4620-a938-4063665667ce (1631ff58-518c-4620-a938-4063665667ce): created successfully Sep 25 10:48:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01cabdb-8d47-4b73-9b41-eed2e45ae8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Flow 'volume_create_manager' (1e7a355f-00bf-49d2-a031-9df0e3acd097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:43 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-104a52fe-83c8-48b0-b13d-89a8924cd650 tempest-GroupsTest-526961660 None] Created volume successfully. Sep 25 10:48:43 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7ef3f1b9-0f53-4ba1-a218-d6cd04f8ecd4 tempest-GroupsTest-526961660 None] Update group completed successfully. Sep 25 10:48:45 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-641f126c-e207-4b39-b031-4f3eec351cc9 tempest-GroupsTest-526961660 None] Update group completed successfully. Sep 25 10:48:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Acquiring lock "cinder-quobyte-1631ff58-518c-4620-a938-4063665667ce" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Lock "cinder-quobyte-1631ff58-518c-4620-a938-4063665667ce" acquired by "delete_volume" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:47 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[029cd8b8-1382-4efb-9123-4b58f28a15d8]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1631ff58-518c-4620-a938-4063665667ce {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:48 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1631ff58-518c-4620-a938-4063665667ce Sep 25 10:48:48 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:48 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1631ff58-518c-4620-a938-4063665667ce" returned: 0 in 0.572s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1631ff58-518c-4620-a938-4063665667ce {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:48 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1631ff58-518c-4620-a938-4063665667ce Sep 25 10:48:48 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:48 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1631ff58-518c-4620-a938-4063665667ce" returned: 0 in 0.377s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:48 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Lock "cinder-quobyte-1631ff58-518c-4620-a938-4063665667ce" released by "delete_volume" :: held 1.031s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:48 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Acquiring lock "cinder-quobyte-3690bb83-5f7b-4f8d-97a1-9207587ead8e" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:48 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Lock "cinder-quobyte-3690bb83-5f7b-4f8d-97a1-9207587ead8e" acquired by "delete_volume" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:49 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aee794-c9a8-4b84-b58e-6f6ba203d297]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:49 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e Sep 25 10:48:49 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:49 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e" returned: 0 in 0.683s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:49 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e Sep 25 10:48:49 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:50 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3690bb83-5f7b-4f8d-97a1-9207587ead8e" returned: 0 in 0.512s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Lock "cinder-quobyte-3690bb83-5f7b-4f8d-97a1-9207587ead8e" released by "delete_volume" :: held 1.264s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:50 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:INSERT=19,cinder:SELECT=92,cinder:UPDATE=96,cinder:DELETE=8 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:48:50 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Created reservations ['c2b4436c-ebdd-4758-8f0d-6665a1e9baee'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:50 devstack cinder-volume[86874]: WARNING cinder.quota [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2093305098 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2093305098, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:48:50 devstack cinder-volume[86874]: WARNING cinder.quota [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2093305098 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2093305098, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:48:50 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Created reservations ['7d0d11a2-b6fe-4ac9-a39a-b263de0c98ef', 'cec40ffd-d755-41a3-96d1-d1d5a59fff55', '277e5a13-862a-4dc2-a08a-5b607df6c2bf', '78129501-d1b0-48c0-9f9b-0ae735486dc6'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:50 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Created reservations ['301523b5-badf-4476-8d69-4eb38540d635', '0df94f84-1fd8-465e-8cb8-fa6e113c72d2', '4c6642da-b7bf-4f94-82b5-dc0d992b4bb3', '367e4528-4188-4107-a4a2-8a0601b43091'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:51 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:48:51 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:51 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.371s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:51 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:48:51 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-9aec41d5-b6a0-43c5-92a0-bfaf62e6c624 tempest-GroupsTest-526961660 None] Delete group completed successfully. Sep 25 10:48:52 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Flow 'volume_create_manager' (db51afe6-b731-4f8e-aeb9-cc6ee8605fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dd433c-692d-4316-88d3-82dff7ac6fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dd433c-692d-4316-88d3-82dff7ac6fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1051183362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89cd0627-4a65-408f-ab9e-d510167d3e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90690c65d07d40f886385e9a666093c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:53Z,use_quota=True,user_id='69e835d6e2a44004b9e1799c1dcc3930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34988cc7-8f8a-4c7b-a9c0-2098ad667699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34988cc7-8f8a-4c7b-a9c0-2098ad667699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd315c5-d707-42ec-b46b-478f16916c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd315c5-d707-42ec-b46b-478f16916c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89cd0627-4a65-408f-ab9e-d510167d3e72', 'volume_name': 'volume-89cd0627-4a65-408f-ab9e-d510167d3e72', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0820680-c594-4eb1-806b-0bb8abd8c46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0820680-c594-4eb1-806b-0bb8abd8c46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af855da1-bc7a-435d-94d3-ab03272ccfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:53 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Volume 89cd0627-4a65-408f-ab9e-d510167d3e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89cd0627-4a65-408f-ab9e-d510167d3e72', 'volume_size': 1} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1051183362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89cd0627-4a65-408f-ab9e-d510167d3e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90690c65d07d40f886385e9a666093c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:53Z,use_quota=True,user_id='69e835d6e2a44004b9e1799c1dcc3930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Creating volume 89cd0627-4a65-408f-ab9e-d510167d3e72 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:48:53 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-89cd0627-4a65-408f-ab9e-d510167d3e72 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:53 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-89cd0627-4a65-408f-ab9e-d510167d3e72 1073741824 Sep 25 10:48:53 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Flow 'volume_create_manager' (0cad1a77-aa24-42f1-83ae-27e04b060786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373fb980-4a95-4566-bd38-8fe3c39cd69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373fb980-4a95-4566-bd38-8fe3c39cd69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1310162181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8995da-08d7-4166-8c0b-6f329efb980b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f3a3a52bdb4ac7ac8e10977ee042b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=60e07bc6-ffbd-4263-b369-e27cc529feec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:53Z,use_quota=True,user_id='daadc5d6fc15425e9722dcb99faf215c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b5ae50-34a1-47f2-ab83-33d35c70be9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b5ae50-34a1-47f2-ab83-33d35c70be9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9b07d6-f27a-4ecd-90d0-0186c6baa529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9b07d6-f27a-4ecd-90d0-0186c6baa529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d8995da-08d7-4166-8c0b-6f329efb980b', 'volume_name': 'volume-2d8995da-08d7-4166-8c0b-6f329efb980b', 'volume_size': 1, 'snapshot_id': '60e07bc6-ffbd-4263-b369-e27cc529feec'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34f6c8c-3b31-471d-9924-684bbc3942c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34f6c8c-3b31-471d-9924-684bbc3942c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1a6ac9-3159-408d-8ea7-84258be1497a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:53 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Volume 2d8995da-08d7-4166-8c0b-6f329efb980b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d8995da-08d7-4166-8c0b-6f329efb980b', 'volume_size': 1, 'snapshot_id': '60e07bc6-ffbd-4263-b369-e27cc529feec'} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:53 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-89cd0627-4a65-408f-ab9e-d510167d3e72 1073741824" returned: 0 in 0.810s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-89cd0627-4a65-408f-ab9e-d510167d3e72 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:53 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-89cd0627-4a65-408f-ab9e-d510167d3e72 Sep 25 10:48:53 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:54 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-89cd0627-4a65-408f-ab9e-d510167d3e72" returned: 0 in 0.400s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.876s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Acquiring lock "cinder-quobyte-60e07bc6-ffbd-4263-b369-e27cc529feec-2d8995da-08d7-4166-8c0b-6f329efb980b" by "_create_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af855da1-bc7a-435d-94d3-ab03272ccfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89cd0627-4a65-408f-ab9e-d510167d3e72', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12f3365-3bf5-4f81-8f34-2675e36618f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Lock "cinder-quobyte-60e07bc6-ffbd-4263-b369-e27cc529feec-2d8995da-08d7-4166-8c0b-6f329efb980b" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Creating volume 2d8995da-08d7-4166-8c0b-6f329efb980b from snapshot 60e07bc6-ffbd-4263-b369-e27cc529feec {{(pid=86874) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Acquiring lock "cinder-quobyte-2d8995da-08d7-4166-8c0b-6f329efb980b" by "_copy_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:54 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Volume volume-89cd0627-4a65-408f-ab9e-d510167d3e72 (89cd0627-4a65-408f-ab9e-d510167d3e72): created successfully Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12f3365-3bf5-4f81-8f34-2675e36618f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Flow 'volume_create_manager' (db51afe6-b731-4f8e-aeb9-cc6ee8605fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Lock "cinder-quobyte-2d8995da-08d7-4166-8c0b-6f329efb980b" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] snapshot: 60e07bc6-ffbd-4263-b369-e27cc529feec, volume: 2d8995da-08d7-4166-8c0b-6f329efb980b, {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:48:54 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6293e01a-a2fe-4f27-b334-aa54170c794f tempest-VolumeQuotasNegativeTestJSON-623702183 None] Created volume successfully. Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ced4bc-f8df-4566-8eb2-a2612cc0872b]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:54 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec Sep 25 10:48:54 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:55 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec" returned: 0 in 0.654s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:48:55 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca439c0-b1e4-4a9d-8e5f-907f35c588c2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:55 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 Sep 25 10:48:55 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:55 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482" returned: 0 in 0.667s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] will copy from snapshot at /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:48:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Creating direct copy from snapshot {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:48:55 devstack cinder-volume[86874]: DEBUG cinder.utils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Path /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b not found in is_blk_device check {{(pid=86874) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 10:48:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:55 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b Sep 25 10:48:55 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Acquiring lock "cinder-89cd0627-4a65-408f-ab9e-d510167d3e72-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Lock "cinder-89cd0627-4a65-408f-ab9e-d510167d3e72-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Acquiring lock "cinder-quobyte-89cd0627-4a65-408f-ab9e-d510167d3e72" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Lock "cinder-quobyte-89cd0627-4a65-408f-ab9e-d510167d3e72" acquired by "delete_volume" :: waited 0.050s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:56 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[482cbb53-d4e0-4856-a39a-ad316bf9c9e4]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-89cd0627-4a65-408f-ab9e-d510167d3e72 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:57 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-89cd0627-4a65-408f-ab9e-d510167d3e72 Sep 25 10:48:57 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:58 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-89cd0627-4a65-408f-ab9e-d510167d3e72" returned: 0 in 1.304s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-89cd0627-4a65-408f-ab9e-d510167d3e72 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:58 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-89cd0627-4a65-408f-ab9e-d510167d3e72 Sep 25 10:48:58 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:58 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-89cd0627-4a65-408f-ab9e-d510167d3e72" returned: 0 in 0.649s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Lock "cinder-quobyte-89cd0627-4a65-408f-ab9e-d510167d3e72" released by "delete_volume" :: held 2.094s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Flow 'volume_create_manager' (fc0bfb73-06e9-4560-bfc6-e4fd1c7377c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12aab5d4-893e-4e3c-ba62-2b387d76a103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12aab5d4-893e-4e3c-ba62-2b387d76a103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1614491607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91337134-2936-476d-ba15-f9055844ff53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ec78e44ded401d8917798aa62d417b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:59Z,use_quota=True,user_id='23f3c046242846b2ba2070438bc8d61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1ec0c7-95e5-4cb8-8f37-8b92fa48b1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1ec0c7-95e5-4cb8-8f37-8b92fa48b1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159ca41d-344d-4aaa-b6b5-3500b70d7cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159ca41d-344d-4aaa-b6b5-3500b70d7cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91337134-2936-476d-ba15-f9055844ff53', 'volume_name': 'volume-91337134-2936-476d-ba15-f9055844ff53', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a408da-a5a2-4c49-95d0-e292954983e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a408da-a5a2-4c49-95d0-e292954983e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194b8ffe-6de0-462d-be30-037d45956b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:59 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Volume 91337134-2936-476d-ba15-f9055844ff53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91337134-2936-476d-ba15-f9055844ff53', 'volume_size': 1} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Created reservations ['9290fc18-01cd-4d4b-8049-27915006869b', '4a4e1ec1-32b6-46d6-a57f-0839ee9565c7', '0d075fdb-aa66-41d8-977b-5a5ef294c0c4', 'a93c44d2-6849-4c4d-9239-d6df4ebeb1d7'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:59 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:48:59 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:00 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.829s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:00 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:00 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Deleted volume successfully. Sep 25 10:49:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0bd78f61-5dda-4b23-92bd-400791057973 tempest-VolumeQuotasNegativeTestJSON-623702183 None] Lock "cinder-89cd0627-4a65-408f-ab9e-d510167d3e72-delete_volume" released by "delete_volume" :: held 3.938s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:07 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b" returned: 0 in 11.204s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482, size 1024.00 MB, duration 11.20 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:49:07 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Converted 1024.00 MB image at 91.39 MB/s Sep 25 10:49:07 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b is being set with open permissions: ugo+rw Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:07 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b Sep 25 10:49:07 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:07 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b" returned: 0 in 0.486s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Lock "cinder-quobyte-2d8995da-08d7-4166-8c0b-6f329efb980b" released by "_copy_volume_from_snapshot" :: held 13.197s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Lock "cinder-quobyte-60e07bc6-ffbd-4263-b369-e27cc529feec-2d8995da-08d7-4166-8c0b-6f329efb980b" released by "_create_volume_from_snapshot" :: held 13.355s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.408s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.523s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1614491607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91337134-2936-476d-ba15-f9055844ff53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ec78e44ded401d8917798aa62d417b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:59Z,use_quota=True,user_id='23f3c046242846b2ba2070438bc8d61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Creating volume 91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:49:07 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:07 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53 1073741824 Sep 25 10:49:07 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1a6ac9-3159-408d-8ea7-84258be1497a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8995da-08d7-4166-8c0b-6f329efb980b', 'volume_size': 1, 'snapshot_id': '60e07bc6-ffbd-4263-b369-e27cc529feec'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ad152a-5996-488d-a530-a0203594c665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:07 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Volume volume-2d8995da-08d7-4166-8c0b-6f329efb980b (2d8995da-08d7-4166-8c0b-6f329efb980b): created successfully Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ad152a-5996-488d-a530-a0203594c665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Flow 'volume_create_manager' (0cad1a77-aa24-42f1-83ae-27e04b060786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:07 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bacaf3d7-e029-4176-b683-1948c43ed87a tempest-TestStampPattern-460870521 None] Created volume successfully. Sep 25 10:49:08 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-60df37fd-683a-439c-a059-1e26e08a31f1 tempest-GroupsV320Test-494890015 None] Group tempest-GroupsV320Test-Group-1614692934: creating Sep 25 10:49:08 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-60df37fd-683a-439c-a059-1e26e08a31f1 tempest-GroupsV320Test-494890015 None] Group tempest-GroupsV320Test-Group-1614692934: created successfully Sep 25 10:49:08 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-60df37fd-683a-439c-a059-1e26e08a31f1 tempest-GroupsV320Test-494890015 None] Create group completed successfully. Sep 25 10:49:08 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53 1073741824" returned: 0 in 0.958s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:08 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53 Sep 25 10:49:08 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:09 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53" returned: 0 in 0.606s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:49:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194b8ffe-6de0-462d-be30-037d45956b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91337134-2936-476d-ba15-f9055844ff53', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7e4c3d-cff7-49e9-8b01-d632bd28f26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:09 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Volume volume-91337134-2936-476d-ba15-f9055844ff53 (91337134-2936-476d-ba15-f9055844ff53): created successfully Sep 25 10:49:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7e4c3d-cff7-49e9-8b01-d632bd28f26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Flow 'volume_create_manager' (fc0bfb73-06e9-4560-bfc6-e4fd1c7377c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:09 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-9d7c8875-6846-43e7-9313-ae14f97564ec tempest-SnapshotsActionsTest-773138594 None] Created volume successfully. Sep 25 10:49:10 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-8b4a5d35-1b33-4296-a734-4c5484daf8ff tempest-GroupsV320Test-494890015 None] Created reservations ['de499547-f78b-411f-a854-8b47b6ac838e'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8b4a5d35-1b33-4296-a734-4c5484daf8ff tempest-GroupsV320Test-494890015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8b4a5d35-1b33-4296-a734-4c5484daf8ff tempest-GroupsV320Test-494890015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:10 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8b4a5d35-1b33-4296-a734-4c5484daf8ff tempest-GroupsV320Test-494890015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:10 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8b4a5d35-1b33-4296-a734-4c5484daf8ff tempest-GroupsV320Test-494890015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8b4a5d35-1b33-4296-a734-4c5484daf8ff tempest-GroupsV320Test-494890015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8b4a5d35-1b33-4296-a734-4c5484daf8ff tempest-GroupsV320Test-494890015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:10 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:49:10 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:10 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] Creating offline snapshot 8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d of volume 91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:49:11 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a449b26-31d6-4e77-b7bc-2b28f03599c0]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:11 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8b4a5d35-1b33-4296-a734-4c5484daf8ff tempest-GroupsV320Test-494890015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.360s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:11 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-8b4a5d35-1b33-4296-a734-4c5484daf8ff tempest-GroupsV320Test-494890015 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:11 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8b4a5d35-1b33-4296-a734-4c5484daf8ff tempest-GroupsV320Test-494890015 None] Delete group completed successfully. Sep 25 10:49:11 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53 Sep 25 10:49:11 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:11 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53" returned: 0 in 0.557s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:11 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d 1G Sep 25 10:49:11 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:12 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d 1G" returned: 0 in 0.912s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:12 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d Sep 25 10:49:12 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:13 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" returned: 0 in 0.604s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:13 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d is being set with open permissions: ugo+rw Sep 25 10:49:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:13 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d Sep 25 10:49:13 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:13 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" returned: 0 in 0.531s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:13 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=110,cinder:UPDATE=123,cinder:INSERT=23,cinder:DELETE=4 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:49:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:13 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.info Sep 25 10:49:13 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:14 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.info" returned: 0 in 0.724s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:14 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.info is being set with open permissions: ugo+rw Sep 25 10:49:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:14 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.info Sep 25 10:49:14 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:15 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.info" returned: 0 in 0.814s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.355s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:15 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c2bbb58d-2614-488d-ad83-120640e5f37a tempest-SnapshotsActionsTest-773138594 None] Create snapshot completed successfully Sep 25 10:49:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] Creating offline snapshot 466080cc-41b4-49a8-8d68-bf53a0e12140 of volume 91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:49:17 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b7ec8c-8053-45de-89dd-3b0fa44d5bce]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:18 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d Sep 25 10:49:18 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:18 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" returned: 0 in 0.947s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91337134-2936-476d-ba15-f9055844ff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:18 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 1G Sep 25 10:49:18 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:19 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 1G" returned: 0 in 0.744s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:19 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 Sep 25 10:49:19 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:20 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140" returned: 0 in 0.569s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:20 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 is being set with open permissions: ugo+rw Sep 25 10:49:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:20 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 Sep 25 10:49:20 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:20 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140" returned: 0 in 0.386s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.884s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:20 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-01d5ef78-978a-431d-ba92-9f879a3bca8b tempest-SnapshotsActionsTest-773138594 None] Create snapshot completed successfully Sep 25 10:49:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Acquiring lock "cinder-466080cc-41b4-49a8-8d68-bf53a0e12140-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-466080cc-41b4-49a8-8d68-bf53a0e12140-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Acquiring lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Acquiring lock "cinder-quobyte-466080cc-41b4-49a8-8d68-bf53a0e12140" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-466080cc-41b4-49a8-8d68-bf53a0e12140" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Deleting offline snapshot 466080cc-41b4-49a8-8d68-bf53a0e12140 of volume 91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:49:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] snapshot_file for this snap is: volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:49:21 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a219fe-c874-475d-9d62-ff456b22cbf1]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:21 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 Sep 25 10:49:21 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:21 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140" returned: 0 in 0.594s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91337134-2936-476d-ba15-f9055844ff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:21 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[090263d4-f4c1-45ff-aaba-1daf6a3deff2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:21 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d Sep 25 10:49:21 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:22 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" returned: 0 in 0.531s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91337134-2936-476d-ba15-f9055844ff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:22 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 Sep 25 10:49:22 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:22 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140" returned: 0 in 0.514s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:22 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140 Sep 25 10:49:22 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:23 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.466080cc-41b4-49a8-8d68-bf53a0e12140" returned: 0 in 0.330s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-466080cc-41b4-49a8-8d68-bf53a0e12140" released by "_delete_snapshot" :: held 2.126s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" released by "delete_snapshot" :: held 2.163s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:23 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Created reservations ['0a464555-0b24-469b-b0ca-47ebe082e9d4', 'de9e7bf7-df73-474f-b0f4-265d31f2ad0c', '8b2ac292-c4e2-43ef-8160-5c0cdb0cd9cd', 'b7992381-75f2-4417-8d6d-8a202e6034d1'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Delete snapshot completed successfully. Sep 25 10:49:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8de888f5-5074-40a8-b7e5-06d7b0d45217 tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-466080cc-41b4-49a8-8d68-bf53a0e12140-delete_snapshot" released by "delete_snapshot" :: held 2.425s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] Creating offline snapshot d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 of volume 91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:49:24 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5963a6-c460-4a2f-85ef-dbb117539782]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:25 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d Sep 25 10:49:25 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:25 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" returned: 0 in 0.720s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91337134-2936-476d-ba15-f9055844ff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:25 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 1G Sep 25 10:49:25 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:26 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:49:26 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:26 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 1G" returned: 0 in 0.806s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:26 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 Sep 25 10:49:26 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:26 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.466s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:49:26 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42" returned: 0 in 0.447s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:26 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 is being set with open permissions: ugo+rw Sep 25 10:49:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:26 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 Sep 25 10:49:26 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:27 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42" returned: 0 in 0.324s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.522s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:27 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6c8dcfa9-c058-4575-8f46-6b8cb0a7bcf0 tempest-SnapshotsActionsTest-773138594 None] Create snapshot completed successfully Sep 25 10:49:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Acquiring lock "cinder-d83d9cc1-7dd7-4dd4-ae52-91f57a921a42-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-d83d9cc1-7dd7-4dd4-ae52-91f57a921a42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Acquiring lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Acquiring lock "cinder-quobyte-d83d9cc1-7dd7-4dd4-ae52-91f57a921a42" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-d83d9cc1-7dd7-4dd4-ae52-91f57a921a42" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Deleting offline snapshot d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 of volume 91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:49:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] snapshot_file for this snap is: volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:49:28 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62f09e3-01f4-4ddf-ad5d-2fbe8eb448b2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:28 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 Sep 25 10:49:28 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:28 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42" returned: 0 in 0.502s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91337134-2936-476d-ba15-f9055844ff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:28 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[331ed5c0-1b16-4373-9a23-9a09498203b5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:28 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d Sep 25 10:49:28 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:29 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" returned: 0 in 0.452s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91337134-2936-476d-ba15-f9055844ff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:29 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 Sep 25 10:49:29 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:29 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42" returned: 0 in 0.494s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:29 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42 Sep 25 10:49:29 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:30 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.d83d9cc1-7dd7-4dd4-ae52-91f57a921a42" returned: 0 in 0.347s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-d83d9cc1-7dd7-4dd4-ae52-91f57a921a42" released by "_delete_snapshot" :: held 1.959s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" released by "delete_snapshot" :: held 1.987s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:30 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Created reservations ['3c4affd0-c223-4e57-a5c7-8915d3a80f8a', 'd49ff049-6a96-4f7f-9408-194e993eff76', 'e4aaf574-eae2-403e-83b9-10678b420df0', '4f711ae6-9d45-47c5-96af-ff2b5dc4a7e4'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:30 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Delete snapshot completed successfully. Sep 25 10:49:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc38abae-2192-4923-a9ce-7410c6ec1afd tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-d83d9cc1-7dd7-4dd4-ae52-91f57a921a42-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] Creating offline snapshot bb9c5261-6d3a-4a90-b9ef-bcd378215f6b of volume 91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:49:32 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40fe2b3-e9c5-4d19-af96-5920a977e6b0]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:32 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d Sep 25 10:49:32 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:32 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" returned: 0 in 0.489s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91337134-2936-476d-ba15-f9055844ff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:32 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b 1G Sep 25 10:49:32 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:33 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b 1G" returned: 0 in 0.658s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:33 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b Sep 25 10:49:33 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:33 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b" returned: 0 in 0.479s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:33 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b is being set with open permissions: ugo+rw Sep 25 10:49:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:33 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b Sep 25 10:49:33 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:33 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b" returned: 0 in 0.311s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.113s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:34 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-daa5738e-3927-4501-aad7-c5e922c72538 tempest-SnapshotsActionsTest-773138594 None] Create snapshot completed successfully Sep 25 10:49:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Acquiring lock "cinder-bb9c5261-6d3a-4a90-b9ef-bcd378215f6b-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-bb9c5261-6d3a-4a90-b9ef-bcd378215f6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Acquiring lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Acquiring lock "cinder-quobyte-bb9c5261-6d3a-4a90-b9ef-bcd378215f6b" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-bb9c5261-6d3a-4a90-b9ef-bcd378215f6b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Deleting offline snapshot bb9c5261-6d3a-4a90-b9ef-bcd378215f6b of volume 91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:49:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] snapshot_file for this snap is: volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:49:35 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[077b9fd3-ed25-4c49-a284-a89fa612ca54]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:35 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b Sep 25 10:49:35 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:36 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b" returned: 0 in 0.603s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91337134-2936-476d-ba15-f9055844ff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:36 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e378c0b-3eeb-489f-a065-46e56f2ce19d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:36 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d Sep 25 10:49:36 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:36 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" returned: 0 in 0.686s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91337134-2936-476d-ba15-f9055844ff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:36 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b Sep 25 10:49:36 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:37 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b" returned: 0 in 0.550s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:37 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b Sep 25 10:49:37 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:37 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.bb9c5261-6d3a-4a90-b9ef-bcd378215f6b" returned: 0 in 0.399s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-bb9c5261-6d3a-4a90-b9ef-bcd378215f6b" released by "_delete_snapshot" :: held 2.390s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" released by "delete_snapshot" :: held 2.427s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:37 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Created reservations ['6c0c0925-b06b-4fe6-a144-2cd5eb35673c', 'a96bc450-e6d4-4d6a-acd1-214cf9bfcb98', 'a2c19d2b-8f28-4f9c-82ad-ad705801be23', '20855447-7cf7-4b91-9075-84d1ff82fb82'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:37 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Delete snapshot completed successfully. Sep 25 10:49:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9c3c9293-1215-43de-a19f-d09a4a5a8c94 tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-bb9c5261-6d3a-4a90-b9ef-bcd378215f6b-delete_snapshot" released by "delete_snapshot" :: held 2.652s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] Creating offline snapshot 51a60dc8-4491-4596-bfd9-da5d7f4584e4 of volume 91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:49:39 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[486576ae-da26-482c-8654-b0b6c109f383]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:39 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d Sep 25 10:49:39 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:40 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" returned: 0 in 0.696s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91337134-2936-476d-ba15-f9055844ff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:40 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 1G Sep 25 10:49:40 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:41 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 1G" returned: 0 in 0.937s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:41 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 Sep 25 10:49:41 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:41 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4" returned: 0 in 0.719s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:41 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 is being set with open permissions: ugo+rw Sep 25 10:49:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:41 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 Sep 25 10:49:41 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:41 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:49:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Flow 'volume_create_manager' (55610f4a-b391-45ea-b78c-a752690c68da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcae6c1-1266-4836-a323-b0d7923e0433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcae6c1-1266-4836-a323-b0d7923e0433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1380992961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a6bbdf9-4590-42af-a108-0c6b4037e71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e136d5d8b74344a2320260d64d41a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:49:42Z,use_quota=True,user_id='56d840e67e8d43d291e709ea101aaeff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37454ffb-27f8-4c35-85aa-dc20714ec82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37454ffb-27f8-4c35-85aa-dc20714ec82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bdfd35-cd84-4ead-bc97-79bfb8b371d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bdfd35-cd84-4ead-bc97-79bfb8b371d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a6bbdf9-4590-42af-a108-0c6b4037e71a', 'volume_name': 'volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52f1d17-822f-4f77-b3b1-7bd9169520ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52f1d17-822f-4f77-b3b1-7bd9169520ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dae7486-63f2-40c1-bf61-ade548fc2986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:42 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Volume 6a6bbdf9-4590-42af-a108-0c6b4037e71a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a', 'volume_size': 1} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:42 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4" returned: 0 in 0.381s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.989s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.176s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1380992961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a6bbdf9-4590-42af-a108-0c6b4037e71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e136d5d8b74344a2320260d64d41a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:49:42Z,use_quota=True,user_id='56d840e67e8d43d291e709ea101aaeff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Creating volume 6a6bbdf9-4590-42af-a108-0c6b4037e71a {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:49:42 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:42 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a 1073741824 Sep 25 10:49:42 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:42 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8ec603f4-1ca9-47f9-93d0-306de09eebfb tempest-SnapshotsActionsTest-773138594 None] Create snapshot completed successfully Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-ded01a0e-2cb8-44f7-9077-507e32b2548b req-25719ebb-d10e-4373-818d-5b69116b1e29 tempest-TestStampPattern-460870521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Acquiring lock "cinder-51a60dc8-4491-4596-bfd9-da5d7f4584e4-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-51a60dc8-4491-4596-bfd9-da5d7f4584e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Acquiring lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Acquiring lock "cinder-quobyte-51a60dc8-4491-4596-bfd9-da5d7f4584e4" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-51a60dc8-4491-4596-bfd9-da5d7f4584e4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Deleting offline snapshot 51a60dc8-4491-4596-bfd9-da5d7f4584e4 of volume 91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] snapshot_file for this snap is: volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[108f41b2-036d-4611-ad7e-c1a2a9fd1e38]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:42 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a 1073741824" returned: 0 in 0.717s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:43 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 Sep 25 10:49:43 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:43 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a Sep 25 10:49:43 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:43 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4" returned: 0 in 0.545s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91337134-2936-476d-ba15-f9055844ff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:43 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a" returned: 0 in 0.419s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-ded01a0e-2cb8-44f7-9077-507e32b2548b req-25719ebb-d10e-4373-818d-5b69116b1e29 tempest-TestStampPattern-460870521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.790s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[01144436-f7a6-4263-8a05-de9c48b76a35]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dae7486-63f2-40c1-bf61-ade548fc2986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d8db10-7dfc-4368-97cd-17a234455a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-ded01a0e-2cb8-44f7-9077-507e32b2548b req-25719ebb-d10e-4373-818d-5b69116b1e29 tempest-TestStampPattern-460870521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:43 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Volume volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a (6a6bbdf9-4590-42af-a108-0c6b4037e71a): created successfully Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d8db10-7dfc-4368-97cd-17a234455a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Flow 'volume_create_manager' (55610f4a-b391-45ea-b78c-a752690c68da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:43 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-32f781c9-f88c-4cc7-919d-8c5670881fd8 tempest-VolumesListAdminTestJSON-461914534 None] Created volume successfully. Sep 25 10:49:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-ded01a0e-2cb8-44f7-9077-507e32b2548b req-25719ebb-d10e-4373-818d-5b69116b1e29 tempest-TestStampPattern-460870521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-2d8995da-08d7-4166-8c0b-6f329efb980b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63393df6-adfa-42dd-a6c8-3680a6342135', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:49:43 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d Sep 25 10:49:43 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:43 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-ded01a0e-2cb8-44f7-9077-507e32b2548b req-25719ebb-d10e-4373-818d-5b69116b1e29 tempest-TestStampPattern-460870521 None] attachment_update completed successfully. Sep 25 10:49:44 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" returned: 0 in 0.602s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91337134-2936-476d-ba15-f9055844ff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:44 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 Sep 25 10:49:44 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:44 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4" returned: 0 in 0.714s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:44 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4 Sep 25 10:49:44 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Flow 'volume_create_manager' (56dca64c-fd25-4d49-8925-2497e9af3862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e018766-521c-4d56-84ca-7a2aff52454a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e018766-521c-4d56-84ca-7a2aff52454a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1115098493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7317db7e-bc4e-4846-91a0-7a67beae0fef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e136d5d8b74344a2320260d64d41a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:49:45Z,use_quota=True,user_id='56d840e67e8d43d291e709ea101aaeff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ba6062-e4b0-4695-a6ff-c17e0a192432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ba6062-e4b0-4695-a6ff-c17e0a192432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8f9d03-678c-444a-bf34-06be616729b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8f9d03-678c-444a-bf34-06be616729b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7317db7e-bc4e-4846-91a0-7a67beae0fef', 'volume_name': 'volume-7317db7e-bc4e-4846-91a0-7a67beae0fef', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cd8126-e81a-46af-9b25-8cdb876e6bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cd8126-e81a-46af-9b25-8cdb876e6bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e264f997-9c6d-4f03-8ef2-81138dd7c357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:45 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Volume 7317db7e-bc4e-4846-91a0-7a67beae0fef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7317db7e-bc4e-4846-91a0-7a67beae0fef', 'volume_size': 1} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1115098493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7317db7e-bc4e-4846-91a0-7a67beae0fef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e136d5d8b74344a2320260d64d41a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:49:45Z,use_quota=True,user_id='56d840e67e8d43d291e709ea101aaeff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Creating volume 7317db7e-bc4e-4846-91a0-7a67beae0fef {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:49:45 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7317db7e-bc4e-4846-91a0-7a67beae0fef 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:45 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7317db7e-bc4e-4846-91a0-7a67beae0fef 1073741824 Sep 25 10:49:45 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:45 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.51a60dc8-4491-4596-bfd9-da5d7f4584e4" returned: 0 in 0.561s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-51a60dc8-4491-4596-bfd9-da5d7f4584e4" released by "_delete_snapshot" :: held 2.577s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" released by "delete_snapshot" :: held 2.613s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Created reservations ['cb97045f-06bf-4338-bf0d-c6082b06f0ec', '7f9ace6a-ff59-47a4-9ee2-52a87e3d791e', '46143afe-947f-4205-aa24-f523ce0b6b87', '032560f2-ab3b-45d7-bbff-c37d81cb9e43'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:45 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Delete snapshot completed successfully. Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0e346ca4-58ec-4c53-b57c-0f39d0d77aeb tempest-SnapshotsActionsTest-1455213034 None] Lock "cinder-51a60dc8-4491-4596-bfd9-da5d7f4584e4-delete_snapshot" released by "delete_snapshot" :: held 2.838s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:45 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7317db7e-bc4e-4846-91a0-7a67beae0fef 1073741824" returned: 0 in 0.661s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7317db7e-bc4e-4846-91a0-7a67beae0fef {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:45 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7317db7e-bc4e-4846-91a0-7a67beae0fef Sep 25 10:49:45 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:46 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7317db7e-bc4e-4846-91a0-7a67beae0fef" returned: 0 in 0.460s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e264f997-9c6d-4f03-8ef2-81138dd7c357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7317db7e-bc4e-4846-91a0-7a67beae0fef', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd021242-485c-4de0-a234-8d80827b6503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:46 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Volume volume-7317db7e-bc4e-4846-91a0-7a67beae0fef (7317db7e-bc4e-4846-91a0-7a67beae0fef): created successfully Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd021242-485c-4de0-a234-8d80827b6503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Flow 'volume_create_manager' (56dca64c-fd25-4d49-8925-2497e9af3862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:46 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bfbdb7b0-85cc-4f6d-881d-a1a2034701d3 tempest-VolumesListAdminTestJSON-461914534 None] Created volume successfully. Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Acquiring lock "cinder-8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Lock "cinder-8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Acquiring lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Acquiring lock "cinder-quobyte-8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Lock "cinder-quobyte-8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Deleting offline snapshot 8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d of volume 91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] snapshot_file for this snap is: volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f68daec-84df-432d-b639-b9e317b613ff]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:47 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d Sep 25 10:49:47 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:47 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" returned: 0 in 0.593s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91337134-2936-476d-ba15-f9055844ff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:47 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45aaa74-27e9-4b63-93b2-2029612604b7]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:47 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53 Sep 25 10:49:47 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:48 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-a2a64d65-53d9-4621-b5f8-70dcb4086a08 req-70c4b2fd-70b1-4fcc-929a-0debbcd54074 tempest-TestStampPattern-460870521 None] Terminate volume connection completed successfully. Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-a2a64d65-53d9-4621-b5f8-70dcb4086a08 req-70c4b2fd-70b1-4fcc-929a-0debbcd54074 tempest-TestStampPattern-460870521 None] Deleting attachment 63393df6-adfa-42dd-a6c8-3680a6342135. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:49:48 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53" returned: 0 in 0.731s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:48 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d Sep 25 10:49:48 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Flow 'volume_create_manager' (ca355ed9-e560-48e7-85e7-342176e1da1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afce27df-9f0f-4a96-906a-93e4ccdd74c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afce27df-9f0f-4a96-906a-93e4ccdd74c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-923149514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b022ff7c-7341-426e-b48c-eabcf138d5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e136d5d8b74344a2320260d64d41a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:49:48Z,use_quota=True,user_id='56d840e67e8d43d291e709ea101aaeff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a548489-4fce-44fc-bf6b-80f0b9ceb40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a548489-4fce-44fc-bf6b-80f0b9ceb40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f5035d-56d8-4d2e-a67c-164a4fd83928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f5035d-56d8-4d2e-a67c-164a4fd83928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b022ff7c-7341-426e-b48c-eabcf138d5ef', 'volume_name': 'volume-b022ff7c-7341-426e-b48c-eabcf138d5ef', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1a784e-ab5f-4c2e-b214-3f4676bbe859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1a784e-ab5f-4c2e-b214-3f4676bbe859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fbaf91-5305-415a-bb4c-41d96283407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:48 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Volume b022ff7c-7341-426e-b48c-eabcf138d5ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b022ff7c-7341-426e-b48c-eabcf138d5ef', 'volume_size': 1} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-923149514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b022ff7c-7341-426e-b48c-eabcf138d5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e136d5d8b74344a2320260d64d41a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:49:48Z,use_quota=True,user_id='56d840e67e8d43d291e709ea101aaeff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Creating volume b022ff7c-7341-426e-b48c-eabcf138d5ef {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:49:48 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b022ff7c-7341-426e-b48c-eabcf138d5ef 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:48 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b022ff7c-7341-426e-b48c-eabcf138d5ef 1073741824 Sep 25 10:49:48 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:48 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" returned: 0 in 0.565s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:48 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d Sep 25 10:49:48 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:49 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53.8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" returned: 0 in 0.357s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:49 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b022ff7c-7341-426e-b48c-eabcf138d5ef 1073741824" returned: 0 in 0.695s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Lock "cinder-quobyte-8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d" released by "_delete_snapshot" :: held 2.441s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" released by "delete_snapshot" :: held 2.473s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b022ff7c-7341-426e-b48c-eabcf138d5ef {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:49 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b022ff7c-7341-426e-b48c-eabcf138d5ef Sep 25 10:49:49 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:49 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Created reservations ['ca5396ee-4f7a-465f-a7a9-34ee66912eaf', '12765749-e272-4419-98bd-5b49ecd3b88f', '73243c95-87ee-4727-b307-0e9100ab2bef', '969e5dc6-4379-41ab-92c1-720f701c46e7'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:49 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Delete snapshot completed successfully. Sep 25 10:49:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dbf07db8-9e7c-40ca-99c0-f74fd3603fcc tempest-SnapshotsActionsTest-773138594 None] Lock "cinder-8d3e2334-5ffa-4fa9-bfe0-1932d12aa55d-delete_snapshot" released by "delete_snapshot" :: held 2.738s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:49 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b022ff7c-7341-426e-b48c-eabcf138d5ef" returned: 0 in 0.362s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:49:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fbaf91-5305-415a-bb4c-41d96283407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b022ff7c-7341-426e-b48c-eabcf138d5ef', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd593e42-e443-426c-9652-4f24c2fe2855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:49 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Volume volume-b022ff7c-7341-426e-b48c-eabcf138d5ef (b022ff7c-7341-426e-b48c-eabcf138d5ef): created successfully Sep 25 10:49:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd593e42-e443-426c-9652-4f24c2fe2855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Flow 'volume_create_manager' (ca355ed9-e560-48e7-85e7-342176e1da1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:49 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2cbcbca2-54d4-4105-a4d1-8249fba0c5d1 tempest-VolumesListAdminTestJSON-461914534 None] Created volume successfully. Sep 25 10:49:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Acquiring lock "cinder-91337134-2936-476d-ba15-f9055844ff53-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Lock "cinder-91337134-2936-476d-ba15-f9055844ff53-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Acquiring lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" acquired by "delete_volume" :: waited 0.044s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:50 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd943150-e6ea-4d18-964b-0df76f15ea2a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:50 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53 Sep 25 10:49:50 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:51 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53" returned: 0 in 0.724s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:51 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53 Sep 25 10:49:51 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:51 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-91337134-2936-476d-ba15-f9055844ff53" returned: 0 in 0.501s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Lock "cinder-quobyte-91337134-2936-476d-ba15-f9055844ff53" released by "delete_volume" :: held 1.399s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:51 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=86,cinder:INSERT=25,cinder:UPDATE=79,cinder:DELETE=8 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:49:51 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Created reservations ['1e082807-678d-4bcd-8c67-2918a8bf712c', 'd7fc30b3-27a5-4b7f-8778-08aef2e10a61', '541aa77a-f2bb-4313-9590-59999abd3f6d', 'd2f45b90-40ae-477a-be48-dcefb1e0f474'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:52 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:49:52 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Flow 'volume_create_manager' (6ac4ba22-d554-4f2f-a41e-121f0cc84bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9276251-23da-4417-98c0-4f927130d240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9276251-23da-4417-98c0-4f927130d240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88947714-092c-448e-ae78-5b9c9982d13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e703f1a1103f4525a7ba74ddebb15bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:49:52Z,use_quota=True,user_id='16aeafd643ee47d7ac7967c0b04384ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ec7445-3776-42b4-937b-f62cfc02d013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ec7445-3776-42b4-937b-f62cfc02d013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3315d49-f1f6-47c8-b0a5-2aee400eed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3315d49-f1f6-47c8-b0a5-2aee400eed89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88947714-092c-448e-ae78-5b9c9982d13a', 'volume_name': 'volume-88947714-092c-448e-ae78-5b9c9982d13a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f5b8a5-6d63-4cdc-b23c-7ceb0e28e09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f5b8a5-6d63-4cdc-b23c-7ceb0e28e09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e70563-f7d4-4528-a511-671debcb55b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:52 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Volume 88947714-092c-448e-ae78-5b9c9982d13a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88947714-092c-448e-ae78-5b9c9982d13a', 'volume_size': 1} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88947714-092c-448e-ae78-5b9c9982d13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e703f1a1103f4525a7ba74ddebb15bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:49:52Z,use_quota=True,user_id='16aeafd643ee47d7ac7967c0b04384ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Creating volume 88947714-092c-448e-ae78-5b9c9982d13a {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:49:52 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-88947714-092c-448e-ae78-5b9c9982d13a 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:52 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-88947714-092c-448e-ae78-5b9c9982d13a 1073741824 Sep 25 10:49:52 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:52 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.695s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:52 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Deleted volume successfully. Sep 25 10:49:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9d8e8c4a-ac11-4f89-97f5-da6f35a4977c tempest-SnapshotsActionsTest-773138594 None] Lock "cinder-91337134-2936-476d-ba15-f9055844ff53-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:53 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-88947714-092c-448e-ae78-5b9c9982d13a 1073741824" returned: 0 in 0.917s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-88947714-092c-448e-ae78-5b9c9982d13a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:53 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-88947714-092c-448e-ae78-5b9c9982d13a Sep 25 10:49:53 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:53 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-88947714-092c-448e-ae78-5b9c9982d13a" returned: 0 in 0.401s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:49:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e70563-f7d4-4528-a511-671debcb55b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88947714-092c-448e-ae78-5b9c9982d13a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361f8d2c-3ebb-4b6a-8e48-a668d1cd51c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:54 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Volume volume-88947714-092c-448e-ae78-5b9c9982d13a (88947714-092c-448e-ae78-5b9c9982d13a): created successfully Sep 25 10:49:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361f8d2c-3ebb-4b6a-8e48-a668d1cd51c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Flow 'volume_create_manager' (6ac4ba22-d554-4f2f-a41e-121f0cc84bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:54 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-9f74a650-015f-4abd-9361-d72f2559f325 tempest-VolumesListAdminTestJSON-188165676 None] Created volume successfully. Sep 25 10:49:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Acquiring lock "cinder-88947714-092c-448e-ae78-5b9c9982d13a-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Lock "cinder-88947714-092c-448e-ae78-5b9c9982d13a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Acquiring lock "cinder-quobyte-88947714-092c-448e-ae78-5b9c9982d13a" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Lock "cinder-quobyte-88947714-092c-448e-ae78-5b9c9982d13a" acquired by "delete_volume" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:54 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dd4ff8-ff8b-4bd7-8bde-b65425a2ddb7]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-88947714-092c-448e-ae78-5b9c9982d13a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "cinder-b022ff7c-7341-426e-b48c-eabcf138d5ef-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Lock "cinder-b022ff7c-7341-426e-b48c-eabcf138d5ef-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "cinder-quobyte-b022ff7c-7341-426e-b48c-eabcf138d5ef" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Lock "cinder-quobyte-b022ff7c-7341-426e-b48c-eabcf138d5ef" acquired by "delete_volume" :: waited 0.042s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:55 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdb2975-7205-4cca-b19e-bb90a91545af]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b022ff7c-7341-426e-b48c-eabcf138d5ef {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:55 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-88947714-092c-448e-ae78-5b9c9982d13a Sep 25 10:49:55 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:55 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b022ff7c-7341-426e-b48c-eabcf138d5ef Sep 25 10:49:55 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:55 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-88947714-092c-448e-ae78-5b9c9982d13a" returned: 0 in 0.984s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-88947714-092c-448e-ae78-5b9c9982d13a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:55 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-88947714-092c-448e-ae78-5b9c9982d13a Sep 25 10:49:55 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:55 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b022ff7c-7341-426e-b48c-eabcf138d5ef" returned: 0 in 0.898s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b022ff7c-7341-426e-b48c-eabcf138d5ef {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:55 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b022ff7c-7341-426e-b48c-eabcf138d5ef Sep 25 10:49:55 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:56 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-88947714-092c-448e-ae78-5b9c9982d13a" returned: 0 in 0.638s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Lock "cinder-quobyte-88947714-092c-448e-ae78-5b9c9982d13a" released by "delete_volume" :: held 1.718s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Created reservations ['3105403c-8582-4ee4-a7d9-f11d743c4237', '5a7b84d7-3a36-4747-bfd0-12257ae7bb1e', '54b486a8-fcb5-42a3-b290-7c62e64a7b11', '266612b0-7fea-4115-b98c-60313cf4dff4'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:56 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b022ff7c-7341-426e-b48c-eabcf138d5ef" returned: 0 in 0.677s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Lock "cinder-quobyte-b022ff7c-7341-426e-b48c-eabcf138d5ef" released by "delete_volume" :: held 1.641s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Created reservations ['d7193308-a6f6-4654-a200-f141a3d8bbb4', '826d4dc5-14aa-4f29-a983-3b431c710482', '66888aa0-ad30-4651-9728-68e3c2fba036', '45da936a-010e-4b6c-9419-4068ba89087a'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:56 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:49:56 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:57 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:49:57 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:57 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.501s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:57 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Deleted volume successfully. Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-74ae04d9-7baf-499a-87ea-b0fe35b96bc0 tempest-VolumesListAdminTestJSON-188165676 None] Lock "cinder-88947714-092c-448e-ae78-5b9c9982d13a-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:57 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.449s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:57 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Deleted volume successfully. Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-101b4b47-6e98-4a0b-97bf-faa1dac6773b tempest-VolumesListAdminTestJSON-461914534 None] Lock "cinder-b022ff7c-7341-426e-b48c-eabcf138d5ef-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "cinder-7317db7e-bc4e-4846-91a0-7a67beae0fef-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Lock "cinder-7317db7e-bc4e-4846-91a0-7a67beae0fef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "cinder-quobyte-7317db7e-bc4e-4846-91a0-7a67beae0fef" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Lock "cinder-quobyte-7317db7e-bc4e-4846-91a0-7a67beae0fef" acquired by "delete_volume" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac44b2-a8a2-46e7-b7db-a72d1156df19]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7317db7e-bc4e-4846-91a0-7a67beae0fef {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:57 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7317db7e-bc4e-4846-91a0-7a67beae0fef Sep 25 10:49:57 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Acquiring lock "cinder-2d8995da-08d7-4166-8c0b-6f329efb980b-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Lock "cinder-2d8995da-08d7-4166-8c0b-6f329efb980b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Acquiring lock "cinder-quobyte-2d8995da-08d7-4166-8c0b-6f329efb980b" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Lock "cinder-quobyte-2d8995da-08d7-4166-8c0b-6f329efb980b" acquired by "delete_volume" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:58 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f488e6-1094-47a3-aa13-e63ea530eb6a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:58 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b Sep 25 10:49:58 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:58 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7317db7e-bc4e-4846-91a0-7a67beae0fef" returned: 0 in 0.738s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7317db7e-bc4e-4846-91a0-7a67beae0fef {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:58 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7317db7e-bc4e-4846-91a0-7a67beae0fef Sep 25 10:49:58 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:58 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7317db7e-bc4e-4846-91a0-7a67beae0fef" returned: 0 in 0.421s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:58 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b" returned: 0 in 0.670s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Lock "cinder-quobyte-7317db7e-bc4e-4846-91a0-7a67beae0fef" released by "delete_volume" :: held 1.248s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:58 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b Sep 25 10:49:58 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Created reservations ['3c02750e-f59b-4667-b3ba-5cc378159da4', '4c93d140-0b8a-490c-801c-61811411d2bc', 'ac167b17-2172-4e9a-8614-392a3b947033', '665b4811-dd19-43b1-813c-3ba81845f765'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:59 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:49:59 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:59 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d8995da-08d7-4166-8c0b-6f329efb980b" returned: 0 in 0.400s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Lock "cinder-quobyte-2d8995da-08d7-4166-8c0b-6f329efb980b" released by "delete_volume" :: held 1.173s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Created reservations ['6887dcbb-07df-4f87-9b1a-c48f345efe6c', '0540f29f-f33a-4f2d-9096-7e8134efd8e6', '02d610fa-25d4-4c19-92cd-13babc2d260f', 'dd85552f-38a1-4876-a7f7-590abbad5d59'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:59 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.427s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:59 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:49:59 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:59 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Deleted volume successfully. Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e7845ca1-a6dd-45f3-ac36-cb6ea991fbbe tempest-VolumesListAdminTestJSON-461914534 None] Lock "cinder-7317db7e-bc4e-4846-91a0-7a67beae0fef-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:59 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.427s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:59 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:59 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Deleted volume successfully. Sep 25 10:50:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c413ef20-252a-4a2e-a5d7-3bf23d5b913b tempest-TestStampPattern-460870521 None] Lock "cinder-2d8995da-08d7-4166-8c0b-6f329efb980b-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "cinder-6a6bbdf9-4590-42af-a108-0c6b4037e71a-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Lock "cinder-6a6bbdf9-4590-42af-a108-0c6b4037e71a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "cinder-quobyte-6a6bbdf9-4590-42af-a108-0c6b4037e71a" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Lock "cinder-quobyte-6a6bbdf9-4590-42af-a108-0c6b4037e71a" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:00 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c75a5e-f4b6-4390-a9b1-b75e5b46c528]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:00 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a Sep 25 10:50:00 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:00 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a" returned: 0 in 0.595s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:00 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a Sep 25 10:50:00 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Acquiring lock "cinder-60e07bc6-ffbd-4263-b369-e27cc529feec-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Lock "cinder-60e07bc6-ffbd-4263-b369-e27cc529feec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Acquiring lock "cinder-quobyte-d5f7759d-e3cb-4de2-9e36-d5b7c826f482" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Lock "cinder-quobyte-d5f7759d-e3cb-4de2-9e36-d5b7c826f482" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Acquiring lock "cinder-quobyte-60e07bc6-ffbd-4263-b369-e27cc529feec" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Lock "cinder-quobyte-60e07bc6-ffbd-4263-b369-e27cc529feec" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Deleting offline snapshot 60e07bc6-ffbd-4263-b369-e27cc529feec of volume d5f7759d-e3cb-4de2-9e36-d5b7c826f482 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] snapshot_file for this snap is: volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[063f9ff4-df68-4427-ba79-8c6487e9358d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:01 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec Sep 25 10:50:01 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:01 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6a6bbdf9-4590-42af-a108-0c6b4037e71a" returned: 0 in 0.513s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Lock "cinder-quobyte-6a6bbdf9-4590-42af-a108-0c6b4037e71a" released by "delete_volume" :: held 1.197s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Created reservations ['acc180e9-c9e5-4358-8dca-5d73e3393baf', 'cfc08d3f-7f29-4d91-aadb-069fb6c13d35', '7861f62d-2dde-4704-9e20-836b9279427b', '99179722-bc81-4e23-b7ac-f41b36746a27'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:01 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:01 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:01 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec" returned: 0 in 0.681s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e8e31c-d43a-4dc1-a21e-623b2ffa6aeb]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:02 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.384s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:02 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:02 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Deleted volume successfully. Sep 25 10:50:02 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 Sep 25 10:50:02 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:02 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6338e8d2-142d-47c0-8549-98e716528715 tempest-VolumesListAdminTestJSON-461914534 None] Lock "cinder-6a6bbdf9-4590-42af-a108-0c6b4037e71a-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:02 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482" returned: 0 in 0.914s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:02 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec Sep 25 10:50:02 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:03 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec" returned: 0 in 0.645s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:03 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec Sep 25 10:50:03 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:03 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482.60e07bc6-ffbd-4263-b369-e27cc529feec" returned: 0 in 0.531s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Lock "cinder-quobyte-60e07bc6-ffbd-4263-b369-e27cc529feec" released by "_delete_snapshot" :: held 2.989s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Lock "cinder-quobyte-d5f7759d-e3cb-4de2-9e36-d5b7c826f482" released by "delete_snapshot" :: held 3.036s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:04 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Created reservations ['84cf8a58-3f62-463e-aca2-680a3079706f', '005b0ed6-6a37-4928-bd2c-a0417a03b499', 'ff22926c-d148-4e59-bb91-464868f3256c', '3a2a0546-1f75-471c-a8c1-61f95766d5be'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:04 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Delete snapshot completed successfully. Sep 25 10:50:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-414310c4-99fb-4ef6-91fb-a478f29b1e6d tempest-TestStampPattern-460870521 None] Lock "cinder-60e07bc6-ffbd-4263-b369-e27cc529feec-delete_snapshot" released by "delete_snapshot" :: held 3.439s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Acquiring lock "cinder-d5f7759d-e3cb-4de2-9e36-d5b7c826f482-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Lock "cinder-d5f7759d-e3cb-4de2-9e36-d5b7c826f482-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Acquiring lock "cinder-quobyte-d5f7759d-e3cb-4de2-9e36-d5b7c826f482" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Lock "cinder-quobyte-d5f7759d-e3cb-4de2-9e36-d5b7c826f482" acquired by "delete_volume" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:13 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[41774010-8d9f-4381-82c9-fb5df0e21190]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:13 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 Sep 25 10:50:13 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:13 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482" returned: 0 in 0.576s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:13 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482 Sep 25 10:50:13 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:14 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d5f7759d-e3cb-4de2-9e36-d5b7c826f482" returned: 0 in 0.452s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Lock "cinder-quobyte-d5f7759d-e3cb-4de2-9e36-d5b7c826f482" released by "delete_volume" :: held 1.174s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:14 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=90,cinder:UPDATE=102,cinder:INSERT=29,cinder:DELETE=8 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:50:14 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Created reservations ['412a723e-f3c1-433b-8558-834a09ca7123', '9098d99e-2b58-4564-abc5-dfe9b3b4035b', '50f2f52f-3de2-4f89-8751-e83165c940a6', '7282ec8f-1758-48dd-a28d-bf4f4db5bff2'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:14 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:14 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:15 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.667s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:15 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Deleted volume successfully. Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fb46baf1-7046-4d16-89cd-4e82bcdf2321 tempest-TestStampPattern-460870521 None] Lock "cinder-d5f7759d-e3cb-4de2-9e36-d5b7c826f482-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Flow 'volume_create_manager' (38cf6d23-626c-4da6-a25a-844424bc53da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8094a98-ef20-4261-97ad-50d699109479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8094a98-ef20-4261-97ad-50d699109479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1197386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33395f54-db29-460a-a848-e388c599fbc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd35f17904d4a7aa16a7aeb569f6902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:16Z,use_quota=True,user_id='22eb1262a2a643f88f3d8cbfc5e560ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a56baa5-0c84-40c6-bb86-bc972f512f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a56baa5-0c84-40c6-bb86-bc972f512f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b444acf-d60a-4331-875a-591b330dee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b444acf-d60a-4331-875a-591b330dee4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33395f54-db29-460a-a848-e388c599fbc2', 'volume_name': 'volume-33395f54-db29-460a-a848-e388c599fbc2', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3bfdb7-ecae-43bb-90c9-a8efc34b8d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3bfdb7-ecae-43bb-90c9-a8efc34b8d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6f7661-acef-44dd-9349-cb8b3f74a02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:15 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Volume 33395f54-db29-460a-a848-e388c599fbc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33395f54-db29-460a-a848-e388c599fbc2', 'volume_size': 1} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1197386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33395f54-db29-460a-a848-e388c599fbc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd35f17904d4a7aa16a7aeb569f6902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:16Z,use_quota=True,user_id='22eb1262a2a643f88f3d8cbfc5e560ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Creating volume 33395f54-db29-460a-a848-e388c599fbc2 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:16 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-33395f54-db29-460a-a848-e388c599fbc2 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:16 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-33395f54-db29-460a-a848-e388c599fbc2 1073741824 Sep 25 10:50:16 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:17 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-33395f54-db29-460a-a848-e388c599fbc2 1073741824" returned: 0 in 1.033s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-33395f54-db29-460a-a848-e388c599fbc2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:17 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-33395f54-db29-460a-a848-e388c599fbc2 Sep 25 10:50:17 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:17 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-33395f54-db29-460a-a848-e388c599fbc2" returned: 0 in 0.509s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6f7661-acef-44dd-9349-cb8b3f74a02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33395f54-db29-460a-a848-e388c599fbc2', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf0217a-51c2-4409-a4e3-8c8b513a453a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:17 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Volume volume-33395f54-db29-460a-a848-e388c599fbc2 (33395f54-db29-460a-a848-e388c599fbc2): created successfully Sep 25 10:50:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf0217a-51c2-4409-a4e3-8c8b513a453a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Flow 'volume_create_manager' (38cf6d23-626c-4da6-a25a-844424bc53da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:17 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-9f275723-0d0d-4437-ba62-32618117ba96 tempest-VolumesActionsTest-906418947 None] Created volume successfully. Sep 25 10:50:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3d89f02c-6588-4c44-ac5e-e99609c86265 tempest-VolumesActionsTest-906418947 None] Acquiring lock "cinder-33395f54-db29-460a-a848-e388c599fbc2" by "attach_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3d89f02c-6588-4c44-ac5e-e99609c86265 tempest-VolumesActionsTest-906418947 None] Lock "cinder-33395f54-db29-460a-a848-e388c599fbc2" acquired by "attach_volume" :: waited 0.045s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-3d89f02c-6588-4c44-ac5e-e99609c86265 tempest-VolumesActionsTest-906418947 None] Attaching volume 33395f54-db29-460a-a848-e388c599fbc2 to instance 64ddebc0-ee1d-4403-9593-9e222f0cceae at mountpoint /dev/vdb on host None. Sep 25 10:50:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-3d89f02c-6588-4c44-ac5e-e99609c86265 tempest-VolumesActionsTest-906418947 None] Attach volume completed successfully. Sep 25 10:50:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3d89f02c-6588-4c44-ac5e-e99609c86265 tempest-VolumesActionsTest-906418947 None] Lock "cinder-33395f54-db29-460a-a848-e388c599fbc2" released by "attach_volume" :: held 0.263s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:19 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f3e41fab-05e6-4c6f-995c-e3aa6f255944 tempest-VolumesActionsTest-964722337 None] Terminate volume connection completed successfully. Sep 25 10:50:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f3e41fab-05e6-4c6f-995c-e3aa6f255944 tempest-VolumesActionsTest-964722337 None] Acquiring lock "cinder-33395f54-db29-460a-a848-e388c599fbc2-detach_volume" by "detach_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f3e41fab-05e6-4c6f-995c-e3aa6f255944 tempest-VolumesActionsTest-964722337 None] Lock "cinder-33395f54-db29-460a-a848-e388c599fbc2-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:20 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f3e41fab-05e6-4c6f-995c-e3aa6f255944 tempest-VolumesActionsTest-964722337 None] Detaching volume 33395f54-db29-460a-a848-e388c599fbc2 from instance 64ddebc0-ee1d-4403-9593-9e222f0cceae. Sep 25 10:50:20 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f3e41fab-05e6-4c6f-995c-e3aa6f255944 tempest-VolumesActionsTest-964722337 None] Detach volume completed successfully. Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f3e41fab-05e6-4c6f-995c-e3aa6f255944 tempest-VolumesActionsTest-964722337 None] Lock "cinder-33395f54-db29-460a-a848-e388c599fbc2-detach_volume" released by "detach_volume" :: held 0.147s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Flow 'volume_create_manager' (8d0ea9c4-8286-4a81-8fda-86425c105a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac5b6f7-9a23-4ec4-a1ab-683c23fb7d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9152ba5d-e939-44c8-bac0-20a5de45e236 tempest-VolumesActionsTest-906418947 None] Acquiring lock "cinder-33395f54-db29-460a-a848-e388c599fbc2-detach_volume" by "detach_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac5b6f7-9a23-4ec4-a1ab-683c23fb7d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-301843376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e351cf1d-54e9-41a3-bd42-2d44a2baf141,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67bfee1b62984efa8283d8cc150f4178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:20Z,use_quota=True,user_id='2635e908ce694d5f9c94c90701e0544b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5930af43-5865-4189-8f77-a30e0a162d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5930af43-5865-4189-8f77-a30e0a162d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678632b8-6924-4a78-a13d-aeb3a144c6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678632b8-6924-4a78-a13d-aeb3a144c6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e351cf1d-54e9-41a3-bd42-2d44a2baf141', 'volume_name': 'volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259c9fc1-3279-4d69-bf9d-5d74fc09058b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259c9fc1-3279-4d69-bf9d-5d74fc09058b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527727a4-b002-4124-a91a-d916d7de82a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:20 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Volume e351cf1d-54e9-41a3-bd42-2d44a2baf141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141', 'volume_size': 1} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-301843376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e351cf1d-54e9-41a3-bd42-2d44a2baf141,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67bfee1b62984efa8283d8cc150f4178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:20Z,use_quota=True,user_id='2635e908ce694d5f9c94c90701e0544b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Creating volume e351cf1d-54e9-41a3-bd42-2d44a2baf141 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:20 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9152ba5d-e939-44c8-bac0-20a5de45e236 tempest-VolumesActionsTest-906418947 None] Lock "cinder-33395f54-db29-460a-a848-e388c599fbc2-detach_volume" acquired by "detach_volume" :: waited 0.157s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:20 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-9152ba5d-e939-44c8-bac0-20a5de45e236 tempest-VolumesActionsTest-906418947 None] Volume detach called, but volume not attached. Sep 25 10:50:20 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141 1073741824 Sep 25 10:50:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9152ba5d-e939-44c8-bac0-20a5de45e236 tempest-VolumesActionsTest-906418947 None] Lock "cinder-33395f54-db29-460a-a848-e388c599fbc2-detach_volume" released by "detach_volume" :: held 0.049s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:20 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Acquiring lock "cinder-33395f54-db29-460a-a848-e388c599fbc2-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Lock "cinder-33395f54-db29-460a-a848-e388c599fbc2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Acquiring lock "cinder-quobyte-33395f54-db29-460a-a848-e388c599fbc2" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Lock "cinder-quobyte-33395f54-db29-460a-a848-e388c599fbc2" acquired by "delete_volume" :: waited 0.025s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:21 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7b4c1a-ed79-4ff5-895e-d81f6a3b4bf2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-33395f54-db29-460a-a848-e388c599fbc2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:21 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:21 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-33395f54-db29-460a-a848-e388c599fbc2 Sep 25 10:50:21 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141 1073741824" returned: 0 in 0.958s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:21 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141 Sep 25 10:50:21 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:22 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-33395f54-db29-460a-a848-e388c599fbc2" returned: 0 in 0.746s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-33395f54-db29-460a-a848-e388c599fbc2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:22 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-33395f54-db29-460a-a848-e388c599fbc2 Sep 25 10:50:22 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:22 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141" returned: 0 in 0.679s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527727a4-b002-4124-a91a-d916d7de82a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141d41ae-1a1b-4869-9e23-203dcf9b3e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:22 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Volume volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141 (e351cf1d-54e9-41a3-bd42-2d44a2baf141): created successfully Sep 25 10:50:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141d41ae-1a1b-4869-9e23-203dcf9b3e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Flow 'volume_create_manager' (8d0ea9c4-8286-4a81-8fda-86425c105a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:22 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-17a453a1-7e65-4ffc-8114-e5677bc7cd67 tempest-VolumesListTestJSON-1891597484 None] Created volume successfully. Sep 25 10:50:23 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-33395f54-db29-460a-a848-e388c599fbc2" returned: 0 in 0.709s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Lock "cinder-quobyte-33395f54-db29-460a-a848-e388c599fbc2" released by "delete_volume" :: held 1.552s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:23 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Created reservations ['2ab2e79e-d7b7-484e-bb8a-697b01591dc8', 'df0a00d8-c28a-4add-a5f5-dd2cf3cdaadd', '8d4f51c7-e7fb-4c37-86c3-b49b9f3114f8', '9108f419-ded7-4dea-aa6e-cf3ba8cad74c'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:23 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:23 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:23 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.584s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:23 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:24 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Deleted volume successfully. Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c23401cd-cf26-4b11-9ccc-4a8c030c4ba9 tempest-VolumesActionsTest-906418947 None] Lock "cinder-33395f54-db29-460a-a848-e388c599fbc2-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Flow 'volume_create_manager' (39c29159-40a0-414b-952f-9c8ef2aec4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf69c01-d096-4a06-b600-52b8e2dc2922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf69c01-d096-4a06-b600-52b8e2dc2922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1561919681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c09655d-bd5e-42be-938c-db660bcae062,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67bfee1b62984efa8283d8cc150f4178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:24Z,use_quota=True,user_id='2635e908ce694d5f9c94c90701e0544b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a09f89e-d518-4f38-836f-2f2d4d40e9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a09f89e-d518-4f38-836f-2f2d4d40e9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa8dd19-3f52-49d7-9e2d-46109eab04dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa8dd19-3f52-49d7-9e2d-46109eab04dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c09655d-bd5e-42be-938c-db660bcae062', 'volume_name': 'volume-9c09655d-bd5e-42be-938c-db660bcae062', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50b0ec6-498e-44f6-a0f6-5258b0cb7941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50b0ec6-498e-44f6-a0f6-5258b0cb7941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3953ee1-e864-47c2-bd4e-76d8adf9645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:24 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Volume 9c09655d-bd5e-42be-938c-db660bcae062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c09655d-bd5e-42be-938c-db660bcae062', 'volume_size': 1} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1561919681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c09655d-bd5e-42be-938c-db660bcae062,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67bfee1b62984efa8283d8cc150f4178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:24Z,use_quota=True,user_id='2635e908ce694d5f9c94c90701e0544b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Creating volume 9c09655d-bd5e-42be-938c-db660bcae062 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:24 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c09655d-bd5e-42be-938c-db660bcae062 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:24 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c09655d-bd5e-42be-938c-db660bcae062 1073741824 Sep 25 10:50:24 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:25 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c09655d-bd5e-42be-938c-db660bcae062 1073741824" returned: 0 in 0.866s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c09655d-bd5e-42be-938c-db660bcae062 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:25 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c09655d-bd5e-42be-938c-db660bcae062 Sep 25 10:50:25 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:25 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c09655d-bd5e-42be-938c-db660bcae062" returned: 0 in 0.434s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3953ee1-e864-47c2-bd4e-76d8adf9645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c09655d-bd5e-42be-938c-db660bcae062', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9737be4b-d1af-49d8-b7aa-5e11075369d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:25 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Volume volume-9c09655d-bd5e-42be-938c-db660bcae062 (9c09655d-bd5e-42be-938c-db660bcae062): created successfully Sep 25 10:50:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9737be4b-d1af-49d8-b7aa-5e11075369d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Flow 'volume_create_manager' (39c29159-40a0-414b-952f-9c8ef2aec4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:25 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f85726f0-c008-47a3-93fb-1c1324dca585 tempest-VolumesListTestJSON-1891597484 None] Created volume successfully. Sep 25 10:50:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:50:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:26 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:26 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:26 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.624s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:50:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:50:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Flow 'volume_create_manager' (3a7b8bff-3fd9-41ee-a838-4b5c8d5d9336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ef1cdb-5cd2-40ab-928b-88a6e726ecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ef1cdb-5cd2-40ab-928b-88a6e726ecc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1553354916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3ef844-4916-4110-bce0-d8f63c20b1ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67bfee1b62984efa8283d8cc150f4178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:27Z,use_quota=True,user_id='2635e908ce694d5f9c94c90701e0544b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a2aa25-e525-4787-a147-4f47d1bb6598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a2aa25-e525-4787-a147-4f47d1bb6598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba415aa-1db9-4185-9a59-22616df7b5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba415aa-1db9-4185-9a59-22616df7b5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd3ef844-4916-4110-bce0-d8f63c20b1ab', 'volume_name': 'volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cc4b83-e1ce-473f-97ac-e7130fdb814e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cc4b83-e1ce-473f-97ac-e7130fdb814e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f20d3e-e1bc-4284-80c1-ba81a234971f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:27 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Volume dd3ef844-4916-4110-bce0-d8f63c20b1ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab', 'volume_size': 1} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1553354916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3ef844-4916-4110-bce0-d8f63c20b1ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67bfee1b62984efa8283d8cc150f4178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:27Z,use_quota=True,user_id='2635e908ce694d5f9c94c90701e0544b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Creating volume dd3ef844-4916-4110-bce0-d8f63c20b1ab {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:27 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:27 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab 1073741824 Sep 25 10:50:27 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:28 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab 1073741824" returned: 0 in 0.875s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:28 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab Sep 25 10:50:28 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:29 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab" returned: 0 in 0.580s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f20d3e-e1bc-4284-80c1-ba81a234971f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b25016c-63c6-4c00-af03-8f0b58d75202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:29 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Volume volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab (dd3ef844-4916-4110-bce0-d8f63c20b1ab): created successfully Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b25016c-63c6-4c00-af03-8f0b58d75202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Flow 'volume_create_manager' (3a7b8bff-3fd9-41ee-a838-4b5c8d5d9336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:29 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ca2b3da2-350f-4359-b35d-a9ab5093d2c2 tempest-VolumesListTestJSON-1891597484 None] Created volume successfully. Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Flow 'volume_create_manager' (766261e0-36b8-4ce2-b623-c5b7bcfc3cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae257c57-e0e5-4831-bca9-47da26a89040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae257c57-e0e5-4831-bca9-47da26a89040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1519938597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720fee15-5606-49d2-8d70-4a0332ef5276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd35f17904d4a7aa16a7aeb569f6902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:29Z,use_quota=True,user_id='22eb1262a2a643f88f3d8cbfc5e560ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5e5477-0a84-437b-b48d-75d4327b22e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5e5477-0a84-437b-b48d-75d4327b22e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efec54e5-589e-46de-981b-46eba5c8ceae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efec54e5-589e-46de-981b-46eba5c8ceae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '720fee15-5606-49d2-8d70-4a0332ef5276', 'volume_name': 'volume-720fee15-5606-49d2-8d70-4a0332ef5276', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24876af9-8cfa-4738-8b49-6b9aeb076199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24876af9-8cfa-4738-8b49-6b9aeb076199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c57d480-2e62-42d0-892b-4409560bfdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:29 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Volume 720fee15-5606-49d2-8d70-4a0332ef5276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-720fee15-5606-49d2-8d70-4a0332ef5276', 'volume_size': 1} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1519938597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720fee15-5606-49d2-8d70-4a0332ef5276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd35f17904d4a7aa16a7aeb569f6902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:29Z,use_quota=True,user_id='22eb1262a2a643f88f3d8cbfc5e560ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Creating volume 720fee15-5606-49d2-8d70-4a0332ef5276 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:29 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-720fee15-5606-49d2-8d70-4a0332ef5276 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:29 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-720fee15-5606-49d2-8d70-4a0332ef5276 1073741824 Sep 25 10:50:29 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:30 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-720fee15-5606-49d2-8d70-4a0332ef5276 1073741824" returned: 0 in 0.754s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-720fee15-5606-49d2-8d70-4a0332ef5276 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:30 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-720fee15-5606-49d2-8d70-4a0332ef5276 Sep 25 10:50:30 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:30 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-720fee15-5606-49d2-8d70-4a0332ef5276" returned: 0 in 0.392s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:30 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c57d480-2e62-42d0-892b-4409560bfdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-720fee15-5606-49d2-8d70-4a0332ef5276', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:30 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215c418d-436d-49d0-ba12-0cd51699f5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:30 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Volume volume-720fee15-5606-49d2-8d70-4a0332ef5276 (720fee15-5606-49d2-8d70-4a0332ef5276): created successfully Sep 25 10:50:30 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215c418d-436d-49d0-ba12-0cd51699f5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:30 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Flow 'volume_create_manager' (766261e0-36b8-4ce2-b623-c5b7bcfc3cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:30 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bffc6f9b-2e2b-4d17-b614-4ce5216626af tempest-VolumesActionsTest-906418947 None] Created volume successfully. Sep 25 10:50:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Acquiring lock "cinder-720fee15-5606-49d2-8d70-4a0332ef5276-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Lock "cinder-720fee15-5606-49d2-8d70-4a0332ef5276-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Acquiring lock "cinder-quobyte-720fee15-5606-49d2-8d70-4a0332ef5276" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Lock "cinder-quobyte-720fee15-5606-49d2-8d70-4a0332ef5276" acquired by "delete_volume" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:32 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[46654dbd-2040-4b5c-9312-27f438c3b06e]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-720fee15-5606-49d2-8d70-4a0332ef5276 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:32 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-720fee15-5606-49d2-8d70-4a0332ef5276 Sep 25 10:50:32 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:32 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-720fee15-5606-49d2-8d70-4a0332ef5276" returned: 0 in 0.590s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-720fee15-5606-49d2-8d70-4a0332ef5276 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:32 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-720fee15-5606-49d2-8d70-4a0332ef5276 Sep 25 10:50:32 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "cinder-dd3ef844-4916-4110-bce0-d8f63c20b1ab-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Lock "cinder-dd3ef844-4916-4110-bce0-d8f63c20b1ab-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "cinder-quobyte-dd3ef844-4916-4110-bce0-d8f63c20b1ab" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Lock "cinder-quobyte-dd3ef844-4916-4110-bce0-d8f63c20b1ab" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff46bb9-a0e5-43c1-b4ea-a7dd01d1c81a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:33 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-720fee15-5606-49d2-8d70-4a0332ef5276" returned: 0 in 0.549s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Lock "cinder-quobyte-720fee15-5606-49d2-8d70-4a0332ef5276" released by "delete_volume" :: held 1.234s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Created reservations ['bd985cf7-5a7d-4262-b90d-0846c64039ae', '76e24f55-cbe8-4a0a-bbf1-9b59cfa3d708', '9dd1d325-42f1-4a73-969c-24eadb7fb7a1', '56c3f6f1-245f-419e-acd4-826acd7c9cf0'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:33 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab Sep 25 10:50:33 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:33 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:33 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:33 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab" returned: 0 in 0.459s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:33 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab Sep 25 10:50:33 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:33 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.321s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:33 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Deleted volume successfully. Sep 25 10:50:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-30519073-912a-48ac-a01b-a39e6ba90870 tempest-VolumesActionsTest-964722337 None] Lock "cinder-720fee15-5606-49d2-8d70-4a0332ef5276-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:34 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dd3ef844-4916-4110-bce0-d8f63c20b1ab" returned: 0 in 0.451s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Lock "cinder-quobyte-dd3ef844-4916-4110-bce0-d8f63c20b1ab" released by "delete_volume" :: held 0.964s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:34 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Created reservations ['7466e9fd-2bb1-46d8-b542-d4e44732fbda', '13614487-6cbc-4629-9375-81ad14bb17f9', '73200694-6ee1-42c8-a828-8a4276bf9287', '934de3c5-c75e-4933-9143-608e6297d386'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:34 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:34 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:34 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.395s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:34 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:34 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Deleted volume successfully. Sep 25 10:50:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-11c6ca9f-4c66-4b0f-aac4-0e25782b2def tempest-VolumesListTestJSON-1891597484 None] Lock "cinder-dd3ef844-4916-4110-bce0-d8f63c20b1ab-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Flow 'volume_create_manager' (23bc35e1-560d-4c26-9b48-122d128de4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c0e43a-d6a8-4e6f-aee4-04f3f3990bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c0e43a-d6a8-4e6f-aee4-04f3f3990bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-629026136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e95da75-4389-458c-a925-257fef4b9445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd35f17904d4a7aa16a7aeb569f6902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:35Z,use_quota=True,user_id='22eb1262a2a643f88f3d8cbfc5e560ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347d6606-46d0-4a28-9755-055cb133de0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347d6606-46d0-4a28-9755-055cb133de0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ceda857-66eb-4153-b9f1-bfa73de6a7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ceda857-66eb-4153-b9f1-bfa73de6a7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e95da75-4389-458c-a925-257fef4b9445', 'volume_name': 'volume-8e95da75-4389-458c-a925-257fef4b9445', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597420d4-80c3-40f2-8303-f5f60cded0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597420d4-80c3-40f2-8303-f5f60cded0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ba192d-0fca-44d7-838b-ae6ae525208b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:35 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Volume 8e95da75-4389-458c-a925-257fef4b9445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e95da75-4389-458c-a925-257fef4b9445', 'volume_size': 1} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-629026136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e95da75-4389-458c-a925-257fef4b9445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd35f17904d4a7aa16a7aeb569f6902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:35Z,use_quota=True,user_id='22eb1262a2a643f88f3d8cbfc5e560ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Creating volume 8e95da75-4389-458c-a925-257fef4b9445 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:35 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8e95da75-4389-458c-a925-257fef4b9445 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:35 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8e95da75-4389-458c-a925-257fef4b9445 1073741824 Sep 25 10:50:35 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "cinder-9c09655d-bd5e-42be-938c-db660bcae062-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Lock "cinder-9c09655d-bd5e-42be-938c-db660bcae062-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "cinder-quobyte-9c09655d-bd5e-42be-938c-db660bcae062" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Lock "cinder-quobyte-9c09655d-bd5e-42be-938c-db660bcae062" acquired by "delete_volume" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c92c113-8c14-49f6-a07a-ff968227c226]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c09655d-bd5e-42be-938c-db660bcae062 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:36 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c09655d-bd5e-42be-938c-db660bcae062 Sep 25 10:50:36 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:36 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8e95da75-4389-458c-a925-257fef4b9445 1073741824" returned: 0 in 0.905s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8e95da75-4389-458c-a925-257fef4b9445 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:36 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8e95da75-4389-458c-a925-257fef4b9445 Sep 25 10:50:36 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Flow 'volume_create_manager' (5e6859c8-3d48-44d9-9d04-18511b6d5d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed6e9a7-c490-4737-92f5-1cb3bfafa32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed6e9a7-c490-4737-92f5-1cb3bfafa32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1425470371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64de6af3-97b3-40e2-9aec-af5453c46635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f57aef0bd448738dd57da5ba4c4928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:36Z,use_quota=True,user_id='7181f2ff04264c09a92e8651bc9cb971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e954d1d9-5bf5-4122-8982-d2760c129f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e954d1d9-5bf5-4122-8982-d2760c129f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a60143-6066-4b72-a067-f3f4e2496c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a60143-6066-4b72-a067-f3f4e2496c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64de6af3-97b3-40e2-9aec-af5453c46635', 'volume_name': 'volume-64de6af3-97b3-40e2-9aec-af5453c46635', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2341b6b5-b7b9-4df8-be34-222019b7b590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2341b6b5-b7b9-4df8-be34-222019b7b590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c006eb-df0a-4a20-b93d-bafbc4fe037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:36 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Volume 64de6af3-97b3-40e2-9aec-af5453c46635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64de6af3-97b3-40e2-9aec-af5453c46635', 'volume_size': 1} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:36 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c09655d-bd5e-42be-938c-db660bcae062" returned: 0 in 0.578s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c09655d-bd5e-42be-938c-db660bcae062 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:36 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c09655d-bd5e-42be-938c-db660bcae062 Sep 25 10:50:36 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:36 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8e95da75-4389-458c-a925-257fef4b9445" returned: 0 in 0.370s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.222s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1425470371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64de6af3-97b3-40e2-9aec-af5453c46635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f57aef0bd448738dd57da5ba4c4928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:36Z,use_quota=True,user_id='7181f2ff04264c09a92e8651bc9cb971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Creating volume 64de6af3-97b3-40e2-9aec-af5453c46635 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:36 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:36 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635 1073741824 Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ba192d-0fca-44d7-838b-ae6ae525208b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e95da75-4389-458c-a925-257fef4b9445', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:36 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d73781-c00f-41c6-ba58-2f7d2c96f12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:36 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Volume volume-8e95da75-4389-458c-a925-257fef4b9445 (8e95da75-4389-458c-a925-257fef4b9445): created successfully Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d73781-c00f-41c6-ba58-2f7d2c96f12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Flow 'volume_create_manager' (23bc35e1-560d-4c26-9b48-122d128de4f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:36 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-183376a2-5260-4a6e-a9b3-b71352ec4542 tempest-VolumesActionsTest-906418947 None] Created volume successfully. Sep 25 10:50:36 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c09655d-bd5e-42be-938c-db660bcae062" returned: 0 in 0.396s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Lock "cinder-quobyte-9c09655d-bd5e-42be-938c-db660bcae062" released by "delete_volume" :: held 1.077s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Created reservations ['4420bed4-dc27-47d7-84bd-a37f8b03b6ec', 'cdb035eb-c4f3-4eb4-ba62-8b6d98f3187c', 'f93fbc25-9264-4776-a531-6cd44b77b694', '02a74dc0-af3e-441a-85c1-2f34588d49d4'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:37 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:37 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:37 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635 1073741824" returned: 0 in 0.817s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:37 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635 Sep 25 10:50:37 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:37 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.502s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Acquiring lock "cinder-8e95da75-4389-458c-a925-257fef4b9445-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:37 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Deleted volume successfully. Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Lock "cinder-8e95da75-4389-458c-a925-257fef4b9445-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-30f85078-cc85-471d-8ffb-3d1308d1f9d8 tempest-VolumesListTestJSON-1891597484 None] Lock "cinder-9c09655d-bd5e-42be-938c-db660bcae062-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Acquiring lock "cinder-quobyte-8e95da75-4389-458c-a925-257fef4b9445" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Lock "cinder-quobyte-8e95da75-4389-458c-a925-257fef4b9445" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[215732ff-7585-4c81-839e-f86fb795ec12]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8e95da75-4389-458c-a925-257fef4b9445 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:38 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8e95da75-4389-458c-a925-257fef4b9445 Sep 25 10:50:38 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:38 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635" returned: 0 in 0.537s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c006eb-df0a-4a20-b93d-bafbc4fe037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64de6af3-97b3-40e2-9aec-af5453c46635', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5577b500-7800-464b-879c-6682bcd37a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:38 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Volume volume-64de6af3-97b3-40e2-9aec-af5453c46635 (64de6af3-97b3-40e2-9aec-af5453c46635): created successfully Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5577b500-7800-464b-879c-6682bcd37a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Flow 'volume_create_manager' (5e6859c8-3d48-44d9-9d04-18511b6d5d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "cinder-e351cf1d-54e9-41a3-bd42-2d44a2baf141-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:38 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ce6755ea-d840-4029-be85-f1a068914871 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Created volume successfully. Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Lock "cinder-e351cf1d-54e9-41a3-bd42-2d44a2baf141-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "cinder-quobyte-e351cf1d-54e9-41a3-bd42-2d44a2baf141" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Lock "cinder-quobyte-e351cf1d-54e9-41a3-bd42-2d44a2baf141" acquired by "delete_volume" :: waited 0.036s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:38 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8e95da75-4389-458c-a925-257fef4b9445" returned: 0 in 0.652s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8e95da75-4389-458c-a925-257fef4b9445 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbece95d-9409-4992-bcca-c4d410aa3a37]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:38 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8e95da75-4389-458c-a925-257fef4b9445 Sep 25 10:50:38 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:38 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141 Sep 25 10:50:38 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:38 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8e95da75-4389-458c-a925-257fef4b9445" returned: 0 in 0.304s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Lock "cinder-quobyte-8e95da75-4389-458c-a925-257fef4b9445" released by "delete_volume" :: held 1.028s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:38 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141" returned: 0 in 0.424s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:38 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141 Sep 25 10:50:38 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Created reservations ['804e908b-abdf-49c0-8e42-d1db9b538db6', 'dab738cd-fda5-4d3a-8641-a8f3a2b72bdc', 'a41e25dd-5478-4c05-80c9-5b6293da1dcb', 'c6e4468b-9666-40c2-8e40-bcf445119300'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Creating offline snapshot c6623db3-0ab7-44d0-ae91-67d565dd4916 of volume 64de6af3-97b3-40e2-9aec-af5453c46635 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:50:39 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:39 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df74c20-9c73-4ee5-bb98-765bad9f1797]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:39 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e351cf1d-54e9-41a3-bd42-2d44a2baf141" returned: 0 in 0.386s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Lock "cinder-quobyte-e351cf1d-54e9-41a3-bd42-2d44a2baf141" released by "delete_volume" :: held 0.912s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:39 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635 Sep 25 10:50:39 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Created reservations ['d4d72af4-a2ba-4d32-b355-1129f78ce8f6', '304a8e8c-2fbd-423e-b1b3-4b5fde01f80d', '192ec990-ceb0-4b5c-84ba-e4a3734b27c8', '8ac69346-7846-42be-9493-f74f647f98bb'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:39 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:39 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:39 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.442s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:39 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Deleted volume successfully. Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a37ef1eb-aca8-4a99-930a-f9140a6cb24f tempest-VolumesActionsTest-964722337 None] Lock "cinder-8e95da75-4389-458c-a925-257fef4b9445-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:39 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635" returned: 0 in 0.546s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:39 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 1G Sep 25 10:50:39 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:39 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.378s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:39 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:39 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Deleted volume successfully. Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6d95ec8d-e859-43bf-bc2c-ab075b080a76 tempest-VolumesListTestJSON-1891597484 None] Lock "cinder-e351cf1d-54e9-41a3-bd42-2d44a2baf141-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:40 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 1G" returned: 0 in 0.726s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64de6af3-97b3-40e2-9aec-af5453c46635 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:40 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64de6af3-97b3-40e2-9aec-af5453c46635 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 Sep 25 10:50:40 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Flow 'volume_create_manager' (0c93749e-6bbc-4a08-b160-ad0a49af675e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c489f23-66d1-4de9-95e0-573a2c3a6eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c489f23-66d1-4de9-95e0-573a2c3a6eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1587608772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f756e8ed-7335-47a0-a1ac-109547529c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd35f17904d4a7aa16a7aeb569f6902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:41Z,use_quota=True,user_id='22eb1262a2a643f88f3d8cbfc5e560ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a61192-bc38-4edd-80cd-7098ce3f57df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a61192-bc38-4edd-80cd-7098ce3f57df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1905ec5b-b0f2-42de-98a7-27b681a081cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1905ec5b-b0f2-42de-98a7-27b681a081cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f756e8ed-7335-47a0-a1ac-109547529c2b', 'volume_name': 'volume-f756e8ed-7335-47a0-a1ac-109547529c2b', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f9199e-244f-473c-9ade-c364df2f1e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f9199e-244f-473c-9ade-c364df2f1e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378c0b1d-4086-4407-a286-13a88ff0ecb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:40 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Volume f756e8ed-7335-47a0-a1ac-109547529c2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f756e8ed-7335-47a0-a1ac-109547529c2b', 'volume_size': 1} Sep 25 10:50:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:40 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64de6af3-97b3-40e2-9aec-af5453c46635 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916" returned: 0 in 0.433s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:41 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 is being set with open permissions: ugo+rw Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:41 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 Sep 25 10:50:41 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:41 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916" returned: 0 in 0.395s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:41 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.info Sep 25 10:50:41 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Flow 'volume_create_manager' (c721b5fe-4431-4002-8d75-4c444f5c426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0858ac8-b68f-401b-b0a2-64f51c275063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0858ac8-b68f-401b-b0a2-64f51c275063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1384714296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2da732c-9d80-4e67-bc26-e75ba2742b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a479ad595c424d891651a7b150967d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:42Z,use_quota=True,user_id='730d0cc54234428782404843f83997a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6491ea4-0676-4146-943e-b9aa9bdfe6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6491ea4-0676-4146-943e-b9aa9bdfe6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510d34c8-0f1d-4712-996d-8f3b473a4d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510d34c8-0f1d-4712-996d-8f3b473a4d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2da732c-9d80-4e67-bc26-e75ba2742b0d', 'volume_name': 'volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ceab05-0d13-45f3-b49d-902624728e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ceab05-0d13-45f3-b49d-902624728e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fca4876-094d-47e6-98bc-db192b0f99fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:41 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Volume a2da732c-9d80-4e67-bc26-e75ba2742b0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d', 'volume_size': 1} Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:41 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.info" returned: 0 in 0.525s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:41 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.info is being set with open permissions: ugo+rw Sep 25 10:50:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:42 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.info Sep 25 10:50:42 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Flow 'volume_create_manager' (b8955314-de0d-4acd-9695-137d281809ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eefaed1-eaec-4270-9e22-aabc1c6a70b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eefaed1-eaec-4270-9e22-aabc1c6a70b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-914396347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a479ad595c424d891651a7b150967d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:42Z,use_quota=True,user_id='730d0cc54234428782404843f83997a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eebc14e3-e6e3-4894-bff5-675d61fdd974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eebc14e3-e6e3-4894-bff5-675d61fdd974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ff1fd6-fbb6-4225-b77f-4c1ac605860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ff1fd6-fbb6-4225-b77f-4c1ac605860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a', 'volume_name': 'volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faad2a60-ee01-4b06-8859-8ff5bb9878d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faad2a60-ee01-4b06-8859-8ff5bb9878d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fe5127-3ed5-4da8-8d8b-cc6abae79607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:42 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Volume 8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a', 'volume_size': 1} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:42 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.info" returned: 0 in 0.473s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.286s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.602s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1587608772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f756e8ed-7335-47a0-a1ac-109547529c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd35f17904d4a7aa16a7aeb569f6902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:41Z,use_quota=True,user_id='22eb1262a2a643f88f3d8cbfc5e560ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Creating volume f756e8ed-7335-47a0-a1ac-109547529c2b {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:42 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f756e8ed-7335-47a0-a1ac-109547529c2b 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:42 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f756e8ed-7335-47a0-a1ac-109547529c2b 1073741824 Sep 25 10:50:42 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:42 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-138ccacb-41f3-48f5-a55c-1908e8e0f8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Create snapshot completed successfully Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Flow 'volume_create_manager' (90053426-2254-4e2e-b0e8-1ca37ea4cb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25df11eb-f1f5-4e48-904a-0173ca8e19af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25df11eb-f1f5-4e48-904a-0173ca8e19af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-870766145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8ff3dc-4540-4ded-b55c-580241ac834c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a479ad595c424d891651a7b150967d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:43Z,use_quota=True,user_id='730d0cc54234428782404843f83997a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b5bc65-d94e-46a3-9e6f-40217d87b5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b5bc65-d94e-46a3-9e6f-40217d87b5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc35bd86-c128-40ea-b659-c66cafe6ac0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc35bd86-c128-40ea-b659-c66cafe6ac0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca8ff3dc-4540-4ded-b55c-580241ac834c', 'volume_name': 'volume-ca8ff3dc-4540-4ded-b55c-580241ac834c', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf6c88f-ac55-4ebc-93d2-6149104d9acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf6c88f-ac55-4ebc-93d2-6149104d9acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b777e9-c332-4476-83da-de9915024d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:42 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Volume ca8ff3dc-4540-4ded-b55c-580241ac834c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca8ff3dc-4540-4ded-b55c-580241ac834c', 'volume_size': 1} Sep 25 10:50:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:43 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f756e8ed-7335-47a0-a1ac-109547529c2b 1073741824" returned: 0 in 0.766s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:43 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Flow 'volume_create_manager' (08fa8296-7cbc-4fcb-9c64-2cd3e0d2cee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb03268-aaf3-4be3-bdd7-eb3fa8a98ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb03268-aaf3-4be3-bdd7-eb3fa8a98ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1025367633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6857bc-f3dc-4afd-a901-e7cc0e2ccf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a479ad595c424d891651a7b150967d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:43Z,use_quota=True,user_id='730d0cc54234428782404843f83997a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9ef001-fcb5-40d9-b1f3-ec68b8105628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9ef001-fcb5-40d9-b1f3-ec68b8105628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df80ba85-7cdd-4c45-a1b3-6c43defb331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df80ba85-7cdd-4c45-a1b3-6c43defb331b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af6857bc-f3dc-4afd-a901-e7cc0e2ccf81', 'volume_name': 'volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38466d3d-b57e-4525-b1ab-7fdbdddccba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38466d3d-b57e-4525-b1ab-7fdbdddccba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79741474-e183-46b0-a9f4-9c09075fabd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:43 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Volume af6857bc-f3dc-4afd-a901-e7cc0e2ccf81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81', 'volume_size': 1} Sep 25 10:50:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f756e8ed-7335-47a0-a1ac-109547529c2b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:43 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f756e8ed-7335-47a0-a1ac-109547529c2b Sep 25 10:50:43 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:44 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f756e8ed-7335-47a0-a1ac-109547529c2b" returned: 0 in 0.498s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.160s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1384714296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2da732c-9d80-4e67-bc26-e75ba2742b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a479ad595c424d891651a7b150967d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:42Z,use_quota=True,user_id='730d0cc54234428782404843f83997a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Creating volume a2da732c-9d80-4e67-bc26-e75ba2742b0d {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:44 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:44 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d 1073741824 Sep 25 10:50:44 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378c0b1d-4086-4407-a286-13a88ff0ecb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f756e8ed-7335-47a0-a1ac-109547529c2b', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f88eda0-acb9-45ad-822a-a632a8bbca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:44 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Volume volume-f756e8ed-7335-47a0-a1ac-109547529c2b (f756e8ed-7335-47a0-a1ac-109547529c2b): created successfully Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f88eda0-acb9-45ad-822a-a632a8bbca76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Flow 'volume_create_manager' (0c93749e-6bbc-4a08-b160-ad0a49af675e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Acquiring lock "cinder-c6623db3-0ab7-44d0-ae91-67d565dd4916-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Flow 'volume_create_manager' (0a1901d6-f601-4522-b709-e2377fd272eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6488fd-886c-444c-82a8-2dcc9df2331e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:44 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ea29dc20-abed-4b85-a9c4-dbf9feda442e tempest-VolumesActionsTest-906418947 None] Created volume successfully. Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6488fd-886c-444c-82a8-2dcc9df2331e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2076618499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e699f72f-74c0-48f5-a53e-67cd6536ed3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a479ad595c424d891651a7b150967d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:44Z,use_quota=True,user_id='730d0cc54234428782404843f83997a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207755c5-0b9e-44ec-ab11-b11b9eb80036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207755c5-0b9e-44ec-ab11-b11b9eb80036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62576e5-d3ea-419f-8cdb-00e970e0f59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62576e5-d3ea-419f-8cdb-00e970e0f59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e699f72f-74c0-48f5-a53e-67cd6536ed3c', 'volume_name': 'volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcf95d1-562c-401c-9971-580bb22b9dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcf95d1-562c-401c-9971-580bb22b9dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3efc8e6f-44a1-4c93-89a4-0effdf6cc3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:44 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Volume e699f72f-74c0-48f5-a53e-67cd6536ed3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c', 'volume_size': 1} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "cinder-c6623db3-0ab7-44d0-ae91-67d565dd4916-delete_snapshot" acquired by "delete_snapshot" :: waited 0.185s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Acquiring lock "cinder-quobyte-64de6af3-97b3-40e2-9aec-af5453c46635" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "cinder-quobyte-64de6af3-97b3-40e2-9aec-af5453c46635" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Acquiring lock "cinder-quobyte-c6623db3-0ab7-44d0-ae91-67d565dd4916" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "cinder-quobyte-c6623db3-0ab7-44d0-ae91-67d565dd4916" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Deleting offline snapshot c6623db3-0ab7-44d0-ae91-67d565dd4916 of volume 64de6af3-97b3-40e2-9aec-af5453c46635 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] snapshot_file for this snap is: volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cf012e-b008-49b3-948d-8994a338fea2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:44 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d 1073741824" returned: 0 in 0.650s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:44 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d Sep 25 10:50:44 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:44 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 Sep 25 10:50:44 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:45 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d" returned: 0 in 0.355s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.864s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-914396347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a479ad595c424d891651a7b150967d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:42Z,use_quota=True,user_id='730d0cc54234428782404843f83997a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Creating volume 8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:45 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fca4876-094d-47e6-98bc-db192b0f99fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:45 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a 1073741824 Sep 25 10:50:45 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802960b7-76f9-4e5a-b5ff-c4c4a7a41aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:45 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916" returned: 0 in 0.542s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64de6af3-97b3-40e2-9aec-af5453c46635(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:50:45 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Volume volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d (a2da732c-9d80-4e67-bc26-e75ba2742b0d): created successfully Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802960b7-76f9-4e5a-b5ff-c4c4a7a41aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Flow 'volume_create_manager' (c721b5fe-4431-4002-8d75-4c444f5c426f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e468eafe-8fd4-4993-bd5e-675911f679d8]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:45 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2df047f0-556c-47ee-a2c1-effa8d2ee190 tempest-CreateVolumesFromImageTest-1992765722 None] Created volume successfully. Sep 25 10:50:45 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635 Sep 25 10:50:45 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Acquiring lock "cinder-f756e8ed-7335-47a0-a1ac-109547529c2b-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Lock "cinder-f756e8ed-7335-47a0-a1ac-109547529c2b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Acquiring lock "cinder-quobyte-f756e8ed-7335-47a0-a1ac-109547529c2b" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Lock "cinder-quobyte-f756e8ed-7335-47a0-a1ac-109547529c2b" acquired by "delete_volume" :: waited 0.018s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce24a56-16f6-4e20-985f-00bc6a8b5b50]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f756e8ed-7335-47a0-a1ac-109547529c2b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:45 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f756e8ed-7335-47a0-a1ac-109547529c2b Sep 25 10:50:45 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:45 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a 1073741824" returned: 0 in 0.686s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:45 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635" returned: 0 in 0.632s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:45 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a Sep 25 10:50:45 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:45 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 Sep 25 10:50:45 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:46 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f756e8ed-7335-47a0-a1ac-109547529c2b" returned: 0 in 0.643s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f756e8ed-7335-47a0-a1ac-109547529c2b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:46 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f756e8ed-7335-47a0-a1ac-109547529c2b Sep 25 10:50:46 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:46 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a" returned: 0 in 0.419s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.359s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-870766145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8ff3dc-4540-4ded-b55c-580241ac834c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a479ad595c424d891651a7b150967d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:43Z,use_quota=True,user_id='730d0cc54234428782404843f83997a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Creating volume ca8ff3dc-4540-4ded-b55c-580241ac834c {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:46 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ca8ff3dc-4540-4ded-b55c-580241ac834c 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fe5127-3ed5-4da8-8d8b-cc6abae79607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:46 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ca8ff3dc-4540-4ded-b55c-580241ac834c 1073741824 Sep 25 10:50:46 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca0328b-507c-4a41-a1ab-d610c6d661a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:46 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Volume volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a (8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a): created successfully Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca0328b-507c-4a41-a1ab-d610c6d661a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Flow 'volume_create_manager' (b8955314-de0d-4acd-9695-137d281809ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:46 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-545b7ab9-7d02-43bf-aedc-95a8fa1e0c18 tempest-CreateVolumesFromImageTest-1992765722 None] Created volume successfully. Sep 25 10:50:46 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f756e8ed-7335-47a0-a1ac-109547529c2b" returned: 0 in 0.393s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:46 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916" returned: 0 in 0.755s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Lock "cinder-quobyte-f756e8ed-7335-47a0-a1ac-109547529c2b" released by "delete_volume" :: held 1.106s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:46 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916 Sep 25 10:50:46 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Created reservations ['2eb1bf2f-1c4a-427f-95b4-46528110ea03', 'bd8e27ad-bffa-4d4b-9a4a-8c7018db3083', '8026fa87-ce6d-43ab-8f73-5eb0cbdec53a', '123f4dbe-433e-4e12-9e4e-0739f32cdbdf'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:46 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:46 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:46 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635.c6623db3-0ab7-44d0-ae91-67d565dd4916" returned: 0 in 0.344s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:46 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ca8ff3dc-4540-4ded-b55c-580241ac834c 1073741824" returned: 0 in 0.695s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "cinder-quobyte-c6623db3-0ab7-44d0-ae91-67d565dd4916" released by "_delete_snapshot" :: held 2.490s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "cinder-quobyte-64de6af3-97b3-40e2-9aec-af5453c46635" released by "delete_snapshot" :: held 2.525s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ca8ff3dc-4540-4ded-b55c-580241ac834c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:47 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ca8ff3dc-4540-4ded-b55c-580241ac834c Sep 25 10:50:47 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Created reservations ['0d526582-735e-473c-8ea3-49fbb8a28092', 'c45ce852-c658-417f-8aae-fc954b84da90', 'de808555-ba12-4680-a234-2b37d0ebfada', '8bd9230b-0c78-484c-848c-6f98ccbe26f4'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:47 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Flow 'volume_create_manager' (5d7e1938-1edc-4bb2-a32b-e26b6ac6be87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e8a0c3-da1a-4fcc-b061-c5922830b8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.440s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:47 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Deleted volume successfully. Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e8a0c3-da1a-4fcc-b061-c5922830b8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-603506269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0a84d8-dc8f-438b-913f-55b0c6d603f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b5956373ca4ec0853ab0178c10fa23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:47Z,use_quota=True,user_id='49a2166553e646309d2126e37c870a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2465fe3-eaab-489e-ba9a-70795640778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2465fe3-eaab-489e-ba9a-70795640778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d99de83-a0ec-42df-af2d-a8eed8a3ec9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d99de83-a0ec-42df-af2d-a8eed8a3ec9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0a84d8-dc8f-438b-913f-55b0c6d603f9', 'volume_name': 'volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9', 'volume_size': 2}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2d0284-5392-4f1b-89a4-8a74303fab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2d0284-5392-4f1b-89a4-8a74303fab64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ee837a-5ac0-4c1d-b6b4-5d54d112c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:47 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Volume 6b0a84d8-dc8f-438b-913f-55b0c6d603f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9', 'volume_size': 2} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ce589570-277a-4990-82fe-b3146138200b tempest-VolumesActionsTest-964722337 None] Lock "cinder-f756e8ed-7335-47a0-a1ac-109547529c2b-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:47 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Delete snapshot completed successfully. Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-adf6c825-ea02-4bae-a8c8-62df6fd6386e tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "cinder-c6623db3-0ab7-44d0-ae91-67d565dd4916-delete_snapshot" released by "delete_snapshot" :: held 2.917s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:47 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ca8ff3dc-4540-4ded-b55c-580241ac834c" returned: 0 in 0.384s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.017s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1025367633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6857bc-f3dc-4afd-a901-e7cc0e2ccf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a479ad595c424d891651a7b150967d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:43Z,use_quota=True,user_id='730d0cc54234428782404843f83997a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Creating volume af6857bc-f3dc-4afd-a901-e7cc0e2ccf81 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:47 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b777e9-c332-4476-83da-de9915024d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca8ff3dc-4540-4ded-b55c-580241ac834c', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:47 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81 1073741824 Sep 25 10:50:47 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7280832f-8778-4132-a2a5-f949b709caed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:47 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Volume volume-ca8ff3dc-4540-4ded-b55c-580241ac834c (ca8ff3dc-4540-4ded-b55c-580241ac834c): created successfully Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7280832f-8778-4132-a2a5-f949b709caed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Flow 'volume_create_manager' (90053426-2254-4e2e-b0e8-1ca37ea4cb52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:47 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b0bc1236-b657-481e-b6e4-600af399806a tempest-CreateVolumesFromImageTest-1992765722 None] Created volume successfully. Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Acquiring lock "cinder-64de6af3-97b3-40e2-9aec-af5453c46635-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "cinder-64de6af3-97b3-40e2-9aec-af5453c46635-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Acquiring lock "cinder-quobyte-64de6af3-97b3-40e2-9aec-af5453c46635" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "cinder-quobyte-64de6af3-97b3-40e2-9aec-af5453c46635" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b180da1-ae7e-417c-b70c-a689f4bace7a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:48 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635 Sep 25 10:50:48 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:48 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81 1073741824" returned: 0 in 0.678s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:48 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81 Sep 25 10:50:48 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:48 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635" returned: 0 in 0.555s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:48 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635 Sep 25 10:50:48 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:48 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81" returned: 0 in 0.342s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.079s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2076618499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e699f72f-74c0-48f5-a53e-67cd6536ed3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a479ad595c424d891651a7b150967d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:44Z,use_quota=True,user_id='730d0cc54234428782404843f83997a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Creating volume e699f72f-74c0-48f5-a53e-67cd6536ed3c {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:48 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:48 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c 1073741824 Sep 25 10:50:48 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79741474-e183-46b0-a9f4-9c09075fabd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff74c0cf-a143-486c-ac45-694410e8c27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Flow 'volume_create_manager' (9fe24863-9e45-44be-913e-b0f3ca468088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6884dc-c624-4876-8cdc-6e2696932067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:48 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Volume volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81 (af6857bc-f3dc-4afd-a901-e7cc0e2ccf81): created successfully Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff74c0cf-a143-486c-ac45-694410e8c27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Flow 'volume_create_manager' (08fa8296-7cbc-4fcb-9c64-2cd3e0d2cee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6884dc-c624-4876-8cdc-6e2696932067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2139820510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cd283b-bf15-4de9-8178-b966bdf3dc95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd35f17904d4a7aa16a7aeb569f6902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:49Z,use_quota=True,user_id='22eb1262a2a643f88f3d8cbfc5e560ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35811f08-d85f-4e41-bca3-1aa5eabda542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35811f08-d85f-4e41-bca3-1aa5eabda542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d6bcb5-f59f-497d-ba95-3c842db0ef17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d6bcb5-f59f-497d-ba95-3c842db0ef17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52cd283b-bf15-4de9-8178-b966bdf3dc95', 'volume_name': 'volume-52cd283b-bf15-4de9-8178-b966bdf3dc95', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4440682-4e06-4aa6-ad30-1367ad00cc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:48 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4440682-4e06-4aa6-ad30-1367ad00cc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7bfedf-e1ac-44f0-a72d-e90f9d4c177b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:48 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Volume 52cd283b-bf15-4de9-8178-b966bdf3dc95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52cd283b-bf15-4de9-8178-b966bdf3dc95', 'volume_size': 1} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64de6af3-97b3-40e2-9aec-af5453c46635" returned: 0 in 0.345s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "cinder-quobyte-64de6af3-97b3-40e2-9aec-af5453c46635" released by "delete_volume" :: held 0.994s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:48 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-83cdd86a-0cd0-4132-973f-034f2469605e tempest-CreateVolumesFromImageTest-1992765722 None] Created volume successfully. Sep 25 10:50:48 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Created reservations ['fd8b87db-bb7d-4b96-aaad-d30604c8c557', 'c2ba58e8-378a-4776-a003-e84d0953e97b', '5e6e0d6e-f4d0-437f-828d-43ad343fbb56', 'bd481247-bd88-49d8-93de-88bc9713b753'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:49 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:49 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:49 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c 1073741824" returned: 0 in 0.558s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:49 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c Sep 25 10:50:49 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:49 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.351s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:49 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Deleted volume successfully. Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c722d2c9-99cf-4cf9-aac2-23d71514cfec tempest-VolumeSnapshotQuotasNegativeTestJSON-1362336642 None] Lock "cinder-64de6af3-97b3-40e2-9aec-af5453c46635-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:49 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c" returned: 0 in 0.337s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.160s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-603506269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0a84d8-dc8f-438b-913f-55b0c6d603f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b5956373ca4ec0853ab0178c10fa23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:47Z,use_quota=True,user_id='49a2166553e646309d2126e37c870a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Creating volume 6b0a84d8-dc8f-438b-913f-55b0c6d603f9 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:49 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 2147483648 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:49 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 2147483648 Sep 25 10:50:49 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3efc8e6f-44a1-4c93-89a4-0effdf6cc3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e16404-573f-4127-b4aa-dca553742e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:49 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Volume volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c (e699f72f-74c0-48f5-a53e-67cd6536ed3c): created successfully Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e16404-573f-4127-b4aa-dca553742e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Flow 'volume_create_manager' (0a1901d6-f601-4522-b709-e2377fd272eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:49 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-11f485b1-239e-42d2-b444-13ffad68c997 tempest-CreateVolumesFromImageTest-1992765722 None] Created volume successfully. Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "cinder-e699f72f-74c0-48f5-a53e-67cd6536ed3c-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-e699f72f-74c0-48f5-a53e-67cd6536ed3c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "cinder-quobyte-e699f72f-74c0-48f5-a53e-67cd6536ed3c" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-quobyte-e699f72f-74c0-48f5-a53e-67cd6536ed3c" acquired by "delete_volume" :: waited 0.014s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54c2688-ce62-4c50-ac6b-9e7551ed9156]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:50 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c Sep 25 10:50:50 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:50 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 2147483648" returned: 0 in 0.639s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:50 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 Sep 25 10:50:50 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:50 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c" returned: 0 in 0.453s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:50 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c Sep 25 10:50:50 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:50 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9" returned: 0 in 0.316s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.785s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2139820510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cd283b-bf15-4de9-8178-b966bdf3dc95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd35f17904d4a7aa16a7aeb569f6902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:49Z,use_quota=True,user_id='22eb1262a2a643f88f3d8cbfc5e560ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Creating volume 52cd283b-bf15-4de9-8178-b966bdf3dc95 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:50 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-52cd283b-bf15-4de9-8178-b966bdf3dc95 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ee837a-5ac0-4c1d-b6b4-5d54d112c822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9', 'volume_size': 2}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2105f368-f1b4-487a-95ce-e9839c28b783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:50 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-52cd283b-bf15-4de9-8178-b966bdf3dc95 1073741824 Sep 25 10:50:50 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:50 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Volume volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 (6b0a84d8-dc8f-438b-913f-55b0c6d603f9): created successfully Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2105f368-f1b4-487a-95ce-e9839c28b783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Flow 'volume_create_manager' (5d7e1938-1edc-4bb2-a32b-e26b6ac6be87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:50 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7e96b009-e7ae-4b00-9321-f10c4686c0bb tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Created volume successfully. Sep 25 10:50:50 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e699f72f-74c0-48f5-a53e-67cd6536ed3c" returned: 0 in 0.356s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-quobyte-e699f72f-74c0-48f5-a53e-67cd6536ed3c" released by "delete_volume" :: held 0.859s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Created reservations ['a50c6bde-d8a9-4560-93d2-347b8b7a4e0a', '6212342f-a26a-43f8-ad29-1d5be32e5e48', '641a07e7-43f8-4095-932b-cddc51cf9599', '81c0de10-45e1-4d36-997b-228188fa58db'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:51 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:51 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "cinder-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "cinder-quobyte-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-quobyte-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81" acquired by "delete_volume" :: waited 0.038s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:51 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f799a93e-d73d-46cd-aa37-4b799510571d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:51 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-52cd283b-bf15-4de9-8178-b966bdf3dc95 1073741824" returned: 0 in 0.855s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:51 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.558s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:51 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:51 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Deleted volume successfully. Sep 25 10:50:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-52cd283b-bf15-4de9-8178-b966bdf3dc95 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:51 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81 Sep 25 10:50:51 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:51 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-52cd283b-bf15-4de9-8178-b966bdf3dc95 Sep 25 10:50:51 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c12c9133-5137-48fa-8a0f-3b66837ff013 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-e699f72f-74c0-48f5-a53e-67cd6536ed3c-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:51 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=190,cinder:SELECT=129,cinder:INSERT=45,cinder:DELETE=17 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:52 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81" returned: 0 in 0.737s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:52 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-52cd283b-bf15-4de9-8178-b966bdf3dc95" returned: 0 in 0.515s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.064s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:52 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81 Sep 25 10:50:52 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7bfedf-e1ac-44f0-a72d-e90f9d4c177b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52cd283b-bf15-4de9-8178-b966bdf3dc95', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85df47a5-f32b-4052-abf2-ac17cd035350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Creating offline snapshot d7937c73-0849-4e6e-a983-1969c381c06a of volume 6b0a84d8-dc8f-438b-913f-55b0c6d603f9 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:50:52 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Volume volume-52cd283b-bf15-4de9-8178-b966bdf3dc95 (52cd283b-bf15-4de9-8178-b966bdf3dc95): created successfully Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85df47a5-f32b-4052-abf2-ac17cd035350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Flow 'volume_create_manager' (9fe24863-9e45-44be-913e-b0f3ca468088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a06e26f-119a-47d1-813e-36c2f641879d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:52 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5fbbc6bf-ba99-4856-b70b-8cfdb66275b7 tempest-VolumesActionsTest-906418947 None] Created volume successfully. Sep 25 10:50:52 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 Sep 25 10:50:52 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:52 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81" returned: 0 in 0.400s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-quobyte-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81" released by "delete_volume" :: held 1.220s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Created reservations ['f0ecabb5-fde9-4f4d-8e8c-0f61f31f4f77', 'a3a86bb0-da87-43aa-b70d-936666a79008', 'd6f8e243-ed2d-44c3-b1cd-585ad112682d', '7c0d0926-22ef-4877-ab0e-fb03e782fe14'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:52 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:52 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:52 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9" returned: 0 in 0.597s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a 2G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:52 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a 2G Sep 25 10:50:52 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:53 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.362s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:53 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Deleted volume successfully. Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-303ed8b3-be17-47ce-8f46-0f6153e13ef9 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-af6857bc-f3dc-4afd-a901-e7cc0e2ccf81-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Acquiring lock "cinder-52cd283b-bf15-4de9-8178-b966bdf3dc95-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Lock "cinder-52cd283b-bf15-4de9-8178-b966bdf3dc95-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Acquiring lock "cinder-quobyte-52cd283b-bf15-4de9-8178-b966bdf3dc95" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Lock "cinder-quobyte-52cd283b-bf15-4de9-8178-b966bdf3dc95" acquired by "delete_volume" :: waited 0.034s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ca1a07-2766-4661-92c6-2607cc56c07b]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-52cd283b-bf15-4de9-8178-b966bdf3dc95 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:53 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a 2G" returned: 0 in 0.721s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:53 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a Sep 25 10:50:53 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "cinder-ca8ff3dc-4540-4ded-b55c-580241ac834c-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-ca8ff3dc-4540-4ded-b55c-580241ac834c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:53 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-52cd283b-bf15-4de9-8178-b966bdf3dc95 Sep 25 10:50:53 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "cinder-quobyte-ca8ff3dc-4540-4ded-b55c-580241ac834c" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-quobyte-ca8ff3dc-4540-4ded-b55c-580241ac834c" acquired by "delete_volume" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[26404856-f8f0-4bd1-a9ca-839b5a911256]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ca8ff3dc-4540-4ded-b55c-580241ac834c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:53 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ca8ff3dc-4540-4ded-b55c-580241ac834c Sep 25 10:50:53 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:53 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a" returned: 0 in 0.510s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:54 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a is being set with open permissions: ugo+rw Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:54 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a Sep 25 10:50:54 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:54 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-52cd283b-bf15-4de9-8178-b966bdf3dc95" returned: 0 in 0.676s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-52cd283b-bf15-4de9-8178-b966bdf3dc95 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:54 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-52cd283b-bf15-4de9-8178-b966bdf3dc95 Sep 25 10:50:54 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:54 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:54 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ca8ff3dc-4540-4ded-b55c-580241ac834c" returned: 0 in 0.614s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ca8ff3dc-4540-4ded-b55c-580241ac834c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a" returned: 0 in 0.430s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:54 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ca8ff3dc-4540-4ded-b55c-580241ac834c Sep 25 10:50:54 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:54 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.info Sep 25 10:50:54 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:54 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-52cd283b-bf15-4de9-8178-b966bdf3dc95" returned: 0 in 0.396s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Lock "cinder-quobyte-52cd283b-bf15-4de9-8178-b966bdf3dc95" released by "delete_volume" :: held 1.159s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Created reservations ['b46eda83-8a7b-4559-bf7b-429c94d1a8a0', 'b71d40a7-a96b-4f40-9668-656b33214fb8', '9f0d1cbf-fca4-4bb1-93cb-3b6d768c3a03', '0ddb4878-3cf1-4af1-879f-2272c48d29c1'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:54 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ca8ff3dc-4540-4ded-b55c-580241ac834c" returned: 0 in 0.330s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-quobyte-ca8ff3dc-4540-4ded-b55c-580241ac834c" released by "delete_volume" :: held 1.016s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:54 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:54 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:54 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.info" returned: 0 in 0.352s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:54 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.info is being set with open permissions: ugo+rw Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:54 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Created reservations ['7c4dfea8-447f-4af5-a4bb-e0de39e2dafc', '962659cb-1dcf-46b5-b209-e2a4fd456c03', '8b0df28c-a467-4e8d-9f95-b43a61c1f023', 'b72ff66f-08e0-4f1a-9166-448d79b7ef33'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:54 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.info Sep 25 10:50:54 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:55 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:55 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:55 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.391s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:55 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:55 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Deleted volume successfully. Sep 25 10:50:55 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-635ff172-6fa5-4022-be25-7155c6328117 tempest-VolumesActionsTest-964722337 None] Lock "cinder-52cd283b-bf15-4de9-8178-b966bdf3dc95-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:55 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.info" returned: 0 in 0.491s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.272s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:55 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.375s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:55 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:55 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Deleted volume successfully. Sep 25 10:50:55 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5e859dd5-a677-4568-bb60-09009be6ba6b tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Create snapshot completed successfully Sep 25 10:50:55 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fc3d391a-a7ca-47a0-a8c3-72ab8802cdf4 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-ca8ff3dc-4540-4ded-b55c-580241ac834c-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "cinder-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "cinder-quobyte-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-quobyte-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a" acquired by "delete_volume" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[296bdc28-65b7-4f21-a99f-c27e8ba12d6e]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:56 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a Sep 25 10:50:56 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Acquiring lock "cinder-d7937c73-0849-4e6e-a983-1969c381c06a-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "cinder-d7937c73-0849-4e6e-a983-1969c381c06a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Acquiring lock "cinder-quobyte-6b0a84d8-dc8f-438b-913f-55b0c6d603f9" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "cinder-quobyte-6b0a84d8-dc8f-438b-913f-55b0c6d603f9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Acquiring lock "cinder-quobyte-d7937c73-0849-4e6e-a983-1969c381c06a" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "cinder-quobyte-d7937c73-0849-4e6e-a983-1969c381c06a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Deleting offline snapshot d7937c73-0849-4e6e-a983-1969c381c06a of volume 6b0a84d8-dc8f-438b-913f-55b0c6d603f9 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] snapshot_file for this snap is: volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Flow 'volume_create_manager' (f248f0be-0530-4799-95ab-327a6121eab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cf9089-b901-43ff-8fe4-3d9a87c23ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce05fa4b-f604-4cb8-b8aa-2be04fef16e4]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cf9089-b901-43ff-8fe4-3d9a87c23ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1401770958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b16365-55e5-488b-85e6-2e33dc501f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd35f17904d4a7aa16a7aeb569f6902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:56Z,use_quota=True,user_id='22eb1262a2a643f88f3d8cbfc5e560ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622d8848-2c9c-4908-9ea4-21aa419c660f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622d8848-2c9c-4908-9ea4-21aa419c660f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d6d54f-1faf-477a-965b-6f90a0f520b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d6d54f-1faf-477a-965b-6f90a0f520b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0b16365-55e5-488b-85e6-2e33dc501f40', 'volume_name': 'volume-e0b16365-55e5-488b-85e6-2e33dc501f40', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de5ad9c-494e-475d-be1e-3b52663ecb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de5ad9c-494e-475d-be1e-3b52663ecb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42485190-4770-4b2b-80cd-169fbed14e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:56 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Volume e0b16365-55e5-488b-85e6-2e33dc501f40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0b16365-55e5-488b-85e6-2e33dc501f40', 'volume_size': 1} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1401770958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b16365-55e5-488b-85e6-2e33dc501f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd35f17904d4a7aa16a7aeb569f6902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:56Z,use_quota=True,user_id='22eb1262a2a643f88f3d8cbfc5e560ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Creating volume e0b16365-55e5-488b-85e6-2e33dc501f40 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:56 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e0b16365-55e5-488b-85e6-2e33dc501f40 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:56 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e0b16365-55e5-488b-85e6-2e33dc501f40 1073741824 Sep 25 10:50:56 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:56 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a Sep 25 10:50:56 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:56 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a" returned: 0 in 0.538s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:56 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a Sep 25 10:50:56 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:57 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a" returned: 0 in 0.475s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:50:57 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a" returned: 0 in 0.326s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c25c6d-959c-4c86-a977-ec372153ef23]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-quobyte-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a" released by "delete_volume" :: held 0.960s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Created reservations ['e31a55e3-1556-4eeb-933e-49b2b5e39d74', '09cc527b-54b5-4736-af18-5d789e704bb4', '08c33402-5580-42cd-b64b-2822b651e64f', '51ea5113-fa02-47f5-9601-586b2a66500f'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:57 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e0b16365-55e5-488b-85e6-2e33dc501f40 1073741824" returned: 0 in 0.604s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:57 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 Sep 25 10:50:57 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e0b16365-55e5-488b-85e6-2e33dc501f40 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:57 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e0b16365-55e5-488b-85e6-2e33dc501f40 Sep 25 10:50:57 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:57 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:50:57 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:57 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9" returned: 0 in 0.549s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:57 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a Sep 25 10:50:57 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:57 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e0b16365-55e5-488b-85e6-2e33dc501f40" returned: 0 in 0.359s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42485190-4770-4b2b-80cd-169fbed14e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0b16365-55e5-488b-85e6-2e33dc501f40', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:57 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c981a0a5-37a1-4f6a-bd80-7473003779e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.344s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:57 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Deleted volume successfully. Sep 25 10:50:57 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Volume volume-e0b16365-55e5-488b-85e6-2e33dc501f40 (e0b16365-55e5-488b-85e6-2e33dc501f40): created successfully Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c981a0a5-37a1-4f6a-bd80-7473003779e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Flow 'volume_create_manager' (f248f0be-0530-4799-95ab-327a6121eab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-84d64171-debc-4bb2-9bfc-f239c4d1d12f tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-8297f456-ecaf-4f3c-9d99-30fc8ed8ff1a-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:57 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8be6cf71-5a57-4013-9d15-99ebff51049e tempest-VolumesActionsTest-906418947 None] Created volume successfully. Sep 25 10:50:58 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a" returned: 0 in 0.394s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:58 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a Sep 25 10:50:58 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:58 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9.d7937c73-0849-4e6e-a983-1969c381c06a" returned: 0 in 0.283s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "cinder-quobyte-d7937c73-0849-4e6e-a983-1969c381c06a" released by "_delete_snapshot" :: held 1.912s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "cinder-a2da732c-9d80-4e67-bc26-e75ba2742b0d-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "cinder-quobyte-6b0a84d8-dc8f-438b-913f-55b0c6d603f9" released by "delete_snapshot" :: held 1.964s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-a2da732c-9d80-4e67-bc26-e75ba2742b0d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "cinder-quobyte-a2da732c-9d80-4e67-bc26-e75ba2742b0d" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Created reservations ['751cad5b-64c2-4e1d-94ca-ab83e5eb5aff', '99bb939b-c46e-4759-bd97-6b114a2674ec', '88236843-75b1-496d-81f8-1db3cf7996f9', 'cd799b62-5032-469b-9100-59f251a27e01'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-quobyte-a2da732c-9d80-4e67-bc26-e75ba2742b0d" acquired by "delete_volume" :: waited 0.038s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5754fe-da0c-4496-bc01-74d5bbfc6456]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:58 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Delete snapshot completed successfully. Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-aceeec6b-8967-4729-9e98-55b1e606cc8d tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "cinder-d7937c73-0849-4e6e-a983-1969c381c06a-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:58 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d Sep 25 10:50:58 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Acquiring lock "cinder-6b0a84d8-dc8f-438b-913f-55b0c6d603f9-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "cinder-6b0a84d8-dc8f-438b-913f-55b0c6d603f9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Acquiring lock "cinder-quobyte-6b0a84d8-dc8f-438b-913f-55b0c6d603f9" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "cinder-quobyte-6b0a84d8-dc8f-438b-913f-55b0c6d603f9" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13fbb68-a046-4f32-9962-8c52096b34ea]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:59 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d" returned: 0 in 0.604s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:59 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d Sep 25 10:50:59 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:59 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 Sep 25 10:50:59 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:59 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2da732c-9d80-4e67-bc26-e75ba2742b0d" returned: 0 in 0.409s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-quobyte-a2da732c-9d80-4e67-bc26-e75ba2742b0d" released by "delete_volume" :: held 1.077s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Acquiring lock "cinder-e0b16365-55e5-488b-85e6-2e33dc501f40-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:59 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Lock "cinder-e0b16365-55e5-488b-85e6-2e33dc501f40-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9" returned: 0 in 0.684s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Created reservations ['687c95d7-cc0e-456b-8de8-252634a809dc', '7aa940c0-4aa2-4d0c-8404-e86b5b94c520', '2796bc93-979e-42ea-a81b-038dcca1e34a', 'c3cfd4e7-4d17-4417-8a15-4a89ea14549a'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:59 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9 Sep 25 10:50:59 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Acquiring lock "cinder-quobyte-e0b16365-55e5-488b-85e6-2e33dc501f40" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Lock "cinder-quobyte-e0b16365-55e5-488b-85e6-2e33dc501f40" acquired by "delete_volume" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9b1dcf-0e80-44b2-9acb-098092642d9f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e0b16365-55e5-488b-85e6-2e33dc501f40 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:00 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:51:00 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:00 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6b0a84d8-dc8f-438b-913f-55b0c6d603f9" returned: 0 in 0.419s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:00 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e0b16365-55e5-488b-85e6-2e33dc501f40 Sep 25 10:51:00 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "cinder-quobyte-6b0a84d8-dc8f-438b-913f-55b0c6d603f9" released by "delete_volume" :: held 1.225s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Created reservations ['c82aba32-35e5-430b-84ed-cb9766c8dcb4', 'fae9c02d-d389-4975-9b8c-0c53140c1804', '740d93dd-8ff9-4e8a-96ea-9443e9964672', 'fb0f7e79-ee2b-4b3a-8c96-7381751d2818'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:00 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.336s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:00 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Deleted volume successfully. Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e3fb2183-902f-430d-a64f-d7b46f77ee84 tempest-CreateVolumesFromImageTest-1992765722 None] Lock "cinder-a2da732c-9d80-4e67-bc26-e75ba2742b0d-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:00 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:51:00 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:00 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e0b16365-55e5-488b-85e6-2e33dc501f40" returned: 0 in 0.621s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e0b16365-55e5-488b-85e6-2e33dc501f40 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:00 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e0b16365-55e5-488b-85e6-2e33dc501f40 Sep 25 10:51:00 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:00 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.404s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:00 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Deleted volume successfully. Sep 25 10:51:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cac34c88-c9e0-460d-a0f4-03becf394143 tempest-VolumesSnapshotNegativeTestJSON-2134707237 None] Lock "cinder-6b0a84d8-dc8f-438b-913f-55b0c6d603f9-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:01 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e0b16365-55e5-488b-85e6-2e33dc501f40" returned: 0 in 0.427s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Lock "cinder-quobyte-e0b16365-55e5-488b-85e6-2e33dc501f40" released by "delete_volume" :: held 1.138s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:01 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Created reservations ['93583c57-b46c-4aee-97bb-f33138787752', 'a9011636-671d-4375-b532-0d23a467e0ca', '9ae38b12-1bc2-4357-9bd4-b5422bf97500', 'a45d0374-59d3-493b-97ef-a64be581454d'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:01 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:51:01 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:01 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.358s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:01 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:01 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Deleted volume successfully. Sep 25 10:51:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-929483f5-8c07-4a44-bbbf-9489e6d1a67f tempest-VolumesActionsTest-906418947 None] Lock "cinder-e0b16365-55e5-488b-85e6-2e33dc501f40-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Flow 'volume_create_manager' (c543dc3c-1ab0-4ff4-b7b2-387ba710445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8602e7-7152-4740-b14e-33b6e854d855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8602e7-7152-4740-b14e-33b6e854d855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-286780584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29544a76-6a59-41fd-9b7e-b6ba6d95c85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e00c62900114e47ae9c012070420c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:07Z,use_quota=True,user_id='0b7d6e34258f41dca3589959059eb440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b0e323-f700-446d-b9f9-4862df02cc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b0e323-f700-446d-b9f9-4862df02cc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ed4897-159f-4db1-b053-b6d323823c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ed4897-159f-4db1-b053-b6d323823c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29544a76-6a59-41fd-9b7e-b6ba6d95c85f', 'volume_name': 'volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55789be-503a-4317-b058-a0b9c0ff4585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55789be-503a-4317-b058-a0b9c0ff4585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abba7f4-9866-4c47-8ef0-e7d61926bf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:07 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume 29544a76-6a59-41fd-9b7e-b6ba6d95c85f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f', 'volume_size': 1} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-286780584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29544a76-6a59-41fd-9b7e-b6ba6d95c85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e00c62900114e47ae9c012070420c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:07Z,use_quota=True,user_id='0b7d6e34258f41dca3589959059eb440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Creating volume 29544a76-6a59-41fd-9b7e-b6ba6d95c85f {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:07 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:51:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:07 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f 1073741824 Sep 25 10:51:07 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:08 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f 1073741824" returned: 0 in 0.668s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:08 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f Sep 25 10:51:08 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:08 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f" returned: 0 in 0.401s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:51:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abba7f4-9866-4c47-8ef0-e7d61926bf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ccec82-2b41-4672-aed3-bffaa38c57ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:08 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f (29544a76-6a59-41fd-9b7e-b6ba6d95c85f): created successfully Sep 25 10:51:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ccec82-2b41-4672-aed3-bffaa38c57ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Flow 'volume_create_manager' (c543dc3c-1ab0-4ff4-b7b2-387ba710445a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:08 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f07bc4e2-9bc1-4c05-900f-3a0496a7578b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Created volume successfully. Sep 25 10:51:09 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Flow 'volume_create_manager' (3cb85cc4-3046-4986-9cf5-fceebea619ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a4bb9e7-c94f-4483-aea1-56618fd942c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a4bb9e7-c94f-4483-aea1-56618fd942c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-413596545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba9ee9d-d014-408f-848a-431b2ff0efe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5c24e2d0a754b0da5cc2121d20cb014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:10Z,use_quota=True,user_id='5007318c3a8746d18cce8ca4f908cbc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0e3cb1-9e3a-4233-9c19-8cabc38e0ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0e3cb1-9e3a-4233-9c19-8cabc38e0ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7077ac03-b52a-4709-8f70-fd72e56c8a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:09 devstack cinder-volume[86874]: DEBUG cinder.image.glance [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Creating Keystone auth plugin from conf {{(pid=86874) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:51:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Creating offline snapshot 1cf9f272-cb63-4872-9a3f-ff1130a50760 of volume 29544a76-6a59-41fd-9b7e-b6ba6d95c85f {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:51:09 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[72371b3e-7773-4ca8-b57a-6985ec914b95]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:10 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f Sep 25 10:51:10 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7077ac03-b52a-4709-8f70-fd72e56c8a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ba9ee9d-d014-408f-848a-431b2ff0efe6', 'volume_name': 'volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326453b4-914a-4a90-a2ae-f700e92e2f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326453b4-914a-4a90-a2ae-f700e92e2f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e6a102-610b-4c89-9206-0e5237a24399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:10 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Volume 9ba9ee9d-d014-408f-848a-431b2ff0efe6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 10:51:10 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Trying to clone 9ba9ee9d-d014-408f-848a-431b2ff0efe6 from image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]). {{(pid=86874) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:51:10 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f" returned: 0 in 0.634s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:10 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 1G Sep 25 10:51:10 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:11 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_fu2p2hxadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:51:11 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Image download 20.69 MB at 20.69 MB/s Sep 25 10:51:11 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f368d317-af8e-431e-b5f9-12f301933be5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_fu2p2hxadevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:11 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 1G" returned: 0 in 0.779s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:11 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_fu2p2hxadevstack@QuobyteHD Sep 25 10:51:11 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 Sep 25 10:51:11 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:11 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:11 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_fu2p2hxadevstack@QuobyteHD" returned: 0 in 0.552s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:11 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Temporary image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 is fetched for user 5007318c3a8746d18cce8ca4f908cbc7. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:51:11 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760" returned: 0 in 0.403s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:11 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 is being set with open permissions: ugo+rw Sep 25 10:51:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:11 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 Sep 25 10:51:11 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:11 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bfdcd5-b35b-4618-bbfc-54044441305a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_fu2p2hxadevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:12 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_fu2p2hxadevstack@QuobyteHD Sep 25 10:51:12 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:12 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760" returned: 0 in 0.409s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:12 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.info Sep 25 10:51:12 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:12 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_fu2p2hxadevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:12 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.info" returned: 0 in 0.367s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:12 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.info is being set with open permissions: ugo+rw Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:12 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.info Sep 25 10:51:12 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:12 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.info" returned: 0 in 0.305s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.060s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.649s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-413596545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba9ee9d-d014-408f-848a-431b2ff0efe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5c24e2d0a754b0da5cc2121d20cb014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:10Z,use_quota=True,user_id='5007318c3a8746d18cce8ca4f908cbc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Creating volume 9ba9ee9d-d014-408f-848a-431b2ff0efe6 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:12 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:51:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:13 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 1073741824 Sep 25 10:51:13 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-86f641ae-1a93-46c5-a446-e10855b8919b tempest-CreateVolumesFromSnapshotTest-1244421644 None] Create snapshot completed successfully Sep 25 10:51:13 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 1073741824" returned: 0 in 0.556s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:13 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 Sep 25 10:51:13 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:13 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6" returned: 0 in 0.384s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:51:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:14 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Attempting download of 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}])) to volume 9ba9ee9d-d014-408f-848a-431b2ff0efe6. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 10:51:14 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa61291d-298d-48e1-bfef-cbb28a7ce157]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_7h3gf7ec {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:14 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_7h3gf7ec Sep 25 10:51:14 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:14 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_7h3gf7ec" returned: 0 in 0.484s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_7h3gf7ec {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:14 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_7h3gf7ec Sep 25 10:51:14 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:15 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_7h3gf7ec" returned: 1 in 0.428s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_7h3gf7ec' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc5dccb-3ce1-4118-aae2-d84e52b68e63]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_fu2p2hxadevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Flow 'volume_create_manager' (8e490490-09af-4e0c-9aac-2e9ce72dfe9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc457cc-8d30-4ab2-9eaa-aac7a0906459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:INSERT=49,cinder:UPDATE=218,cinder:SELECT=146,cinder:DELETE=12 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc457cc-8d30-4ab2-9eaa-aac7a0906459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1063505714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d75251-f7b7-4260-a6f0-6d1f896010c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e00c62900114e47ae9c012070420c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:15Z,use_quota=True,user_id='0b7d6e34258f41dca3589959059eb440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3779db-8f7b-4009-bb5b-69864256987b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3779db-8f7b-4009-bb5b-69864256987b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:15 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_fu2p2hxadevstack@QuobyteHD Sep 25 10:51:15 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bfbf55-679e-495d-91db-5a5f1b372c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bfbf55-679e-495d-91db-5a5f1b372c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82d75251-f7b7-4260-a6f0-6d1f896010c1', 'volume_name': 'volume-82d75251-f7b7-4260-a6f0-6d1f896010c1', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a087b9-22e0-4eba-a524-80255ff9491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a087b9-22e0-4eba-a524-80255ff9491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3783705-31e3-4563-b2d1-0e8ea4c5473c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:15 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume 82d75251-f7b7-4260-a6f0-6d1f896010c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82d75251-f7b7-4260-a6f0-6d1f896010c1', 'volume_size': 1} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1063505714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d75251-f7b7-4260-a6f0-6d1f896010c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e00c62900114e47ae9c012070420c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:15Z,use_quota=True,user_id='0b7d6e34258f41dca3589959059eb440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Creating volume 82d75251-f7b7-4260-a6f0-6d1f896010c1 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:15 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d75251-f7b7-4260-a6f0-6d1f896010c1 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:15 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d75251-f7b7-4260-a6f0-6d1f896010c1 1073741824 Sep 25 10:51:15 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Flow 'volume_create_manager' (de05ea58-f6df-430c-bd89-a9d1ac5fc450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff16af27-6f95-49d5-9f73-97ad0c8eb616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:15 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff16af27-6f95-49d5-9f73-97ad0c8eb616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-20962810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00034c17-ef97-4406-a796-7cea5541de67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e00c62900114e47ae9c012070420c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:16Z,use_quota=True,user_id='0b7d6e34258f41dca3589959059eb440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7198bbda-c446-4837-af8f-f3780a8808b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7198bbda-c446-4837-af8f-f3780a8808b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a796d1d-a990-4f73-b829-df93bcadf319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a796d1d-a990-4f73-b829-df93bcadf319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00034c17-ef97-4406-a796-7cea5541de67', 'volume_name': 'volume-00034c17-ef97-4406-a796-7cea5541de67', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4124a2be-0ebb-45d5-848b-1454bd7fa545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4124a2be-0ebb-45d5-848b-1454bd7fa545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4352e4d4-9124-4ba9-b661-4e6eb9a76f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:15 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume 00034c17-ef97-4406-a796-7cea5541de67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00034c17-ef97-4406-a796-7cea5541de67', 'volume_size': 1} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_fu2p2hxadevstack@QuobyteHD" returned: 0 in 0.823s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 was qcow2, converting to qcow2 {{(pid=86874) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:51:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_fu2p2hxadevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:15 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_fu2p2hxadevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 Sep 25 10:51:15 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:16 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Flow 'volume_create_manager' (7c6ac700-40e7-4529-a527-936cabbad371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:16 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35dce0a6-31f9-4d05-a18b-a5e786c2c914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d75251-f7b7-4260-a6f0-6d1f896010c1 1073741824" returned: 0 in 1.204s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35dce0a6-31f9-4d05-a18b-a5e786c2c914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1045267009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653f9c3b-6244-4a40-b6a2-fa2342d25b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e00c62900114e47ae9c012070420c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:16Z,use_quota=True,user_id='0b7d6e34258f41dca3589959059eb440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe96b402-e59b-4930-b603-c55241a87de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe96b402-e59b-4930-b603-c55241a87de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cedfe7d-7168-4e10-8f04-7cadb9f9f5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cedfe7d-7168-4e10-8f04-7cadb9f9f5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '653f9c3b-6244-4a40-b6a2-fa2342d25b7e', 'volume_name': 'volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6a198f-c283-40c3-a9b2-17c5f6547dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6a198f-c283-40c3-a9b2-17c5f6547dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b108dd6-206e-440f-91a0-386133b79c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:16 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume 653f9c3b-6244-4a40-b6a2-fa2342d25b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e', 'volume_size': 1} Sep 25 10:51:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d75251-f7b7-4260-a6f0-6d1f896010c1 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:16 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d75251-f7b7-4260-a6f0-6d1f896010c1 Sep 25 10:51:16 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:17 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d75251-f7b7-4260-a6f0-6d1f896010c1" returned: 0 in 0.508s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.462s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-20962810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00034c17-ef97-4406-a796-7cea5541de67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e00c62900114e47ae9c012070420c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:16Z,use_quota=True,user_id='0b7d6e34258f41dca3589959059eb440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Creating volume 00034c17-ef97-4406-a796-7cea5541de67 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:17 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-00034c17-ef97-4406-a796-7cea5541de67 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:17 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-00034c17-ef97-4406-a796-7cea5541de67 1073741824 Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3783705-31e3-4563-b2d1-0e8ea4c5473c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d75251-f7b7-4260-a6f0-6d1f896010c1', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:17 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417b36f4-bafe-48a3-b730-68d944800b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:17 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume volume-82d75251-f7b7-4260-a6f0-6d1f896010c1 (82d75251-f7b7-4260-a6f0-6d1f896010c1): created successfully Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417b36f4-bafe-48a3-b730-68d944800b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Flow 'volume_create_manager' (8e490490-09af-4e0c-9aac-2e9ce72dfe9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:17 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6b5708a1-7c4b-4eeb-b2c5-02c605b47f45 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Created volume successfully. Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Flow 'volume_create_manager' (66498e9f-4a3c-4e00-94f1-3eb0a5660f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3015d692-81e4-4355-a8d4-644c97307a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3015d692-81e4-4355-a8d4-644c97307a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879190124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f65b525-38db-4ce6-8cc1-895d6cc15ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e00c62900114e47ae9c012070420c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:17Z,use_quota=True,user_id='0b7d6e34258f41dca3589959059eb440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bea2130-c9a9-4a9b-91ca-b9e7a7ad7e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bea2130-c9a9-4a9b-91ca-b9e7a7ad7e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179944ff-73be-49fc-bc0c-0294deca3b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179944ff-73be-49fc-bc0c-0294deca3b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f65b525-38db-4ce6-8cc1-895d6cc15ca4', 'volume_name': 'volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb020646-ee08-42a4-a252-cfa2d401f18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb020646-ee08-42a4-a252-cfa2d401f18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7945218-1407-4166-a7ca-60e1b75e54db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:17 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume 2f65b525-38db-4ce6-8cc1-895d6cc15ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4', 'volume_size': 1} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:17 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Flow 'volume_create_manager' (1c01424d-88bb-4f78-9b62-19d41af743b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a9a77c-02b4-4d51-af14-6f21d700092c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a9a77c-02b4-4d51-af14-6f21d700092c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-569636651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493026ed-eaad-4b5a-9af1-b32866b25cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e00c62900114e47ae9c012070420c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:18Z,use_quota=True,user_id='0b7d6e34258f41dca3589959059eb440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ced144a-cd34-416c-ba5a-972117aecbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ced144a-cd34-416c-ba5a-972117aecbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb01765-5f74-4d0a-90ab-6fbcc813ef7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb01765-5f74-4d0a-90ab-6fbcc813ef7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '493026ed-eaad-4b5a-9af1-b32866b25cfa', 'volume_name': 'volume-493026ed-eaad-4b5a-9af1-b32866b25cfa', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad17b44-e830-4d50-a666-f354890fe41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad17b44-e830-4d50-a666-f354890fe41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2877498-8cbd-4b6c-8b5a-429d91a8c306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:18 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume 493026ed-eaad-4b5a-9af1-b32866b25cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-493026ed-eaad-4b5a-9af1-b32866b25cfa', 'volume_size': 1} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:18 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-00034c17-ef97-4406-a796-7cea5541de67 1073741824" returned: 0 in 0.988s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-00034c17-ef97-4406-a796-7cea5541de67 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:18 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-00034c17-ef97-4406-a796-7cea5541de67 Sep 25 10:51:18 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:18 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-00034c17-ef97-4406-a796-7cea5541de67" returned: 0 in 0.462s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.189s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1045267009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653f9c3b-6244-4a40-b6a2-fa2342d25b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e00c62900114e47ae9c012070420c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:16Z,use_quota=True,user_id='0b7d6e34258f41dca3589959059eb440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Creating volume 653f9c3b-6244-4a40-b6a2-fa2342d25b7e {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:18 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:51:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4352e4d4-9124-4ba9-b661-4e6eb9a76f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00034c17-ef97-4406-a796-7cea5541de67', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:19 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e 1073741824 Sep 25 10:51:19 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b3c1b3-8e67-41a7-bade-1c481b7b8bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:19 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume volume-00034c17-ef97-4406-a796-7cea5541de67 (00034c17-ef97-4406-a796-7cea5541de67): created successfully Sep 25 10:51:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b3c1b3-8e67-41a7-bade-1c481b7b8bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Flow 'volume_create_manager' (de05ea58-f6df-430c-bd89-a9d1ac5fc450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:19 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-91b06c02-34c6-46d1-90f7-b6a867855bd3 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Created volume successfully. Sep 25 10:51:19 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_fu2p2hxadevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6" returned: 0 in 3.579s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:19 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_fu2p2hxadevstack@QuobyteHD, size 112.00 MB, duration 3.58 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:51:19 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Converted 112.00 MB image at 31.28 MB/s Sep 25 10:51:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:19 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 1G Sep 25 10:51:19 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:19 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e 1073741824" returned: 0 in 0.782s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:19 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e Sep 25 10:51:19 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:20 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 1G" returned: 0 in 0.627s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Downloaded image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}])) to volume 9ba9ee9d-d014-408f-848a-431b2ff0efe6 successfully. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Temporary image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 for user 5007318c3a8746d18cce8ca4f908cbc7 is deleted. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Marking volume 9ba9ee9d-d014-408f-848a-431b2ff0efe6 as bootable. {{(pid=86874) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Copying metadata from image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 to 9ba9ee9d-d014-408f-848a-431b2ff0efe6. {{(pid=86874) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Creating volume glance metadata for volume 9ba9ee9d-d014-408f-848a-431b2ff0efe6 backed by image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86874) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:51:20 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e" returned: 0 in 0.444s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.334s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879190124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f65b525-38db-4ce6-8cc1-895d6cc15ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e00c62900114e47ae9c012070420c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:17Z,use_quota=True,user_id='0b7d6e34258f41dca3589959059eb440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Creating volume 2f65b525-38db-4ce6-8cc1-895d6cc15ca4 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:20 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b108dd6-206e-440f-91a0-386133b79c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584edf61-c315-47f4-8e80-915a5103e677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:20 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4 1073741824 Sep 25 10:51:20 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:20 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e (653f9c3b-6244-4a40-b6a2-fa2342d25b7e): created successfully Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584edf61-c315-47f4-8e80-915a5103e677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Flow 'volume_create_manager' (7c6ac700-40e7-4529-a527-936cabbad371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e6a102-610b-4c89-9206-0e5237a24399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fdd061-7ab7-4a3c-8ba1-13d8075f6160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:20 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Volume volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 (9ba9ee9d-d014-408f-848a-431b2ff0efe6): created successfully Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fdd061-7ab7-4a3c-8ba1-13d8075f6160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Flow 'volume_create_manager' (3cb85cc4-3046-4986-9cf5-fceebea619ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:20 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-62506244-4c9b-4f50-baa0-5e7f4d94fd31 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Created volume successfully. Sep 25 10:51:20 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-64eafea3-cffe-4e51-abf3-0fcb6d497cea tempest-VolumesImageMetadata-1722149262 None] Created volume successfully. Sep 25 10:51:21 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4 1073741824" returned: 0 in 0.718s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:21 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4 Sep 25 10:51:21 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:21 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4" returned: 0 in 0.367s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.283s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-569636651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493026ed-eaad-4b5a-9af1-b32866b25cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e00c62900114e47ae9c012070420c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:18Z,use_quota=True,user_id='0b7d6e34258f41dca3589959059eb440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Creating volume 493026ed-eaad-4b5a-9af1-b32866b25cfa {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:21 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-493026ed-eaad-4b5a-9af1-b32866b25cfa 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7945218-1407-4166-a7ca-60e1b75e54db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:21 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-493026ed-eaad-4b5a-9af1-b32866b25cfa 1073741824 Sep 25 10:51:21 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548d6175-8db2-4baa-8b19-46014d9c6dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:21 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4 (2f65b525-38db-4ce6-8cc1-895d6cc15ca4): created successfully Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548d6175-8db2-4baa-8b19-46014d9c6dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Flow 'volume_create_manager' (66498e9f-4a3c-4e00-94f1-3eb0a5660f7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:21 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-0eb3a533-4ab3-4207-b2b1-72955847e577 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Created volume successfully. Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Acquiring lock "cinder-9ba9ee9d-d014-408f-848a-431b2ff0efe6-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Lock "cinder-9ba9ee9d-d014-408f-848a-431b2ff0efe6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Acquiring lock "cinder-quobyte-9ba9ee9d-d014-408f-848a-431b2ff0efe6" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Lock "cinder-quobyte-9ba9ee9d-d014-408f-848a-431b2ff0efe6" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[431524b8-4023-441b-88ea-d5bdaaa9479e]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:22 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-493026ed-eaad-4b5a-9af1-b32866b25cfa 1073741824" returned: 0 in 0.698s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-493026ed-eaad-4b5a-9af1-b32866b25cfa {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:22 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-493026ed-eaad-4b5a-9af1-b32866b25cfa Sep 25 10:51:22 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:22 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 Sep 25 10:51:22 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:22 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-493026ed-eaad-4b5a-9af1-b32866b25cfa" returned: 0 in 0.428s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2877498-8cbd-4b6c-8b5a-429d91a8c306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-493026ed-eaad-4b5a-9af1-b32866b25cfa', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e683da8-cd49-4afd-ac40-b550b6141efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:22 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Volume volume-493026ed-eaad-4b5a-9af1-b32866b25cfa (493026ed-eaad-4b5a-9af1-b32866b25cfa): created successfully Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e683da8-cd49-4afd-ac40-b550b6141efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:22 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Flow 'volume_create_manager' (1c01424d-88bb-4f78-9b62-19d41af743b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6" returned: 0 in 0.635s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:22 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-9d86a4b5-bc92-4b8a-9b14-76feeee38f27 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Created volume successfully. Sep 25 10:51:22 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6 Sep 25 10:51:22 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:23 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ba9ee9d-d014-408f-848a-431b2ff0efe6" returned: 0 in 0.309s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Lock "cinder-quobyte-9ba9ee9d-d014-408f-848a-431b2ff0efe6" released by "delete_volume" :: held 1.015s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Created reservations ['ce6731ff-bc88-44f8-956d-7b34e4662355', '8cc0e4b8-a03c-408c-acec-663cedd049a3', 'aded7d12-baf9-422e-b239-e91e991d5de7', 'e265805e-51d1-4f88-bbda-8f57c5cef05d'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:23 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:51:23 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:23 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.323s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Deleted volume successfully. Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e1785ca9-024c-40e6-a7b3-8c7a10d94b85 tempest-VolumesImageMetadata-1722149262 None] Lock "cinder-9ba9ee9d-d014-408f-848a-431b2ff0efe6-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-493026ed-eaad-4b5a-9af1-b32866b25cfa-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-493026ed-eaad-4b5a-9af1-b32866b25cfa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-quobyte-493026ed-eaad-4b5a-9af1-b32866b25cfa" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-493026ed-eaad-4b5a-9af1-b32866b25cfa" acquired by "delete_volume" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da6be4c-ddc7-4c5c-9afb-6777717d6810]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-493026ed-eaad-4b5a-9af1-b32866b25cfa {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:24 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-493026ed-eaad-4b5a-9af1-b32866b25cfa Sep 25 10:51:24 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:24 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-493026ed-eaad-4b5a-9af1-b32866b25cfa" returned: 0 in 0.629s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-493026ed-eaad-4b5a-9af1-b32866b25cfa {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:24 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-493026ed-eaad-4b5a-9af1-b32866b25cfa Sep 25 10:51:24 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:25 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-493026ed-eaad-4b5a-9af1-b32866b25cfa" returned: 0 in 0.463s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-493026ed-eaad-4b5a-9af1-b32866b25cfa" released by "delete_volume" :: held 1.164s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:25 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Created reservations ['06ca9055-1932-4e9e-9040-6275f685bf80', '9c3b1cf8-02b5-4224-9010-d3de563806b6', '972a79e3-759f-441c-ab05-f09b28f659ac', '9744c25d-7c0b-4069-b225-63d435bd65c1'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:25 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:51:25 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:25 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.471s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:25 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:25 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Deleted volume successfully. Sep 25 10:51:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d76e1901-0864-4f73-8d10-393a62e713bc tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-493026ed-eaad-4b5a-9af1-b32866b25cfa-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:26 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:51:26 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-2f65b525-38db-4ce6-8cc1-895d6cc15ca4-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-2f65b525-38db-4ce6-8cc1-895d6cc15ca4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-quobyte-2f65b525-38db-4ce6-8cc1-895d6cc15ca4" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-2f65b525-38db-4ce6-8cc1-895d6cc15ca4" acquired by "delete_volume" :: waited 0.040s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d0517e-8690-4385-9627-846acfa50f89]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:26 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4 Sep 25 10:51:26 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:26 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.637s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:51:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:51:27 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4" returned: 0 in 0.622s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:27 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4 Sep 25 10:51:27 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:27 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2f65b525-38db-4ce6-8cc1-895d6cc15ca4" returned: 0 in 0.463s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-2f65b525-38db-4ce6-8cc1-895d6cc15ca4" released by "delete_volume" :: held 1.174s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:27 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Created reservations ['21c19305-ef22-449c-9531-04f8082f8e73', '0cd0693a-fea5-4679-ae3d-2b45a5a1f75a', '675f2140-cea3-4a09-9c68-c8c2ca47ce80', '830e6ac1-6570-415b-bda7-09591b897266'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:27 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:51:27 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:28 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.369s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:28 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:28 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Deleted volume successfully. Sep 25 10:51:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e562b5a4-efaa-4708-aa19-2f76d8ce7816 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-2f65b525-38db-4ce6-8cc1-895d6cc15ca4-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-653f9c3b-6244-4a40-b6a2-fa2342d25b7e-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-653f9c3b-6244-4a40-b6a2-fa2342d25b7e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-quobyte-653f9c3b-6244-4a40-b6a2-fa2342d25b7e" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-653f9c3b-6244-4a40-b6a2-fa2342d25b7e" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:28 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d4a7cc-d4f9-44f8-ab11-60f4cb10f4e4]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:28 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e Sep 25 10:51:28 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:29 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e" returned: 0 in 0.537s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:29 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e Sep 25 10:51:29 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:29 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-653f9c3b-6244-4a40-b6a2-fa2342d25b7e" returned: 0 in 0.389s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-653f9c3b-6244-4a40-b6a2-fa2342d25b7e" released by "delete_volume" :: held 0.988s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:29 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Created reservations ['4c95f35b-8ddb-49a7-b470-b75395cd25a6', '8cef7cad-106b-412f-b08a-1818804da7ff', '40bf3717-8c4b-4922-a2c7-debb1d0e49dd', '5b7b7ecc-b299-4e7e-9b4e-7e527cf7e73c'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:30 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:51:30 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:30 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.363s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:30 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:30 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Deleted volume successfully. Sep 25 10:51:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53d58517-85eb-4866-afc8-ccd566528fd6 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-653f9c3b-6244-4a40-b6a2-fa2342d25b7e-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-00034c17-ef97-4406-a796-7cea5541de67-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-00034c17-ef97-4406-a796-7cea5541de67-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-quobyte-00034c17-ef97-4406-a796-7cea5541de67" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-00034c17-ef97-4406-a796-7cea5541de67" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:30 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5796c57c-a599-4b61-a4cc-f72c965ba58d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-00034c17-ef97-4406-a796-7cea5541de67 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:31 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-00034c17-ef97-4406-a796-7cea5541de67 Sep 25 10:51:31 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Flow 'volume_create_manager' (1e17884b-47bb-4181-a884-f2db1b5a154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463cf397-297c-4a83-a9b7-2e5d8bbb0fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463cf397-297c-4a83-a9b7-2e5d8bbb0fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-854293013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9c56f3-8078-41f9-b358-b3f8f482b5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c4f22d37cc403e82d6278a4af86a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:31Z,use_quota=True,user_id='64a4f464ee9042bd9b32ff3eaff2d847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adfbd83-34ba-4674-b203-d1c5a424bd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adfbd83-34ba-4674-b203-d1c5a424bd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca27cb77-09cf-4a18-8ec5-0c9306c01f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca27cb77-09cf-4a18-8ec5-0c9306c01f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e9c56f3-8078-41f9-b358-b3f8f482b5fd', 'volume_name': 'volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3706a082-d83e-41ea-9812-a30fd4dda1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3706a082-d83e-41ea-9812-a30fd4dda1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4514f7-8bf7-4740-82e0-16cbf6876cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:31 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Volume 6e9c56f3-8078-41f9-b358-b3f8f482b5fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd', 'volume_size': 1} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-854293013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9c56f3-8078-41f9-b358-b3f8f482b5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c4f22d37cc403e82d6278a4af86a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:31Z,use_quota=True,user_id='64a4f464ee9042bd9b32ff3eaff2d847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Creating volume 6e9c56f3-8078-41f9-b358-b3f8f482b5fd {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:31 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:31 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd 1073741824 Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:31 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Flow 'volume_create_manager' (6cf5cc19-c7d2-490c-bb4f-d112b52b055f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3fb6cf-b44b-4c5e-8aa8-5119207e7ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3fb6cf-b44b-4c5e-8aa8-5119207e7ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-513502819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07641ac-409e-422d-aea5-81694b9a016f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3b106a928f47a69f58c303fcd9f135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:31Z,use_quota=True,user_id='029589c21abe41aba5979fb7dacccc2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c388d57-98e4-4aeb-bfc3-c5b22566e782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c388d57-98e4-4aeb-bfc3-c5b22566e782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b61bc0-d0ba-4d8b-a043-fde2a9f3d3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b61bc0-d0ba-4d8b-a043-fde2a9f3d3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a07641ac-409e-422d-aea5-81694b9a016f', 'volume_name': 'volume-a07641ac-409e-422d-aea5-81694b9a016f', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7a98d7-42b0-4fec-9798-68181850e6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7a98d7-42b0-4fec-9798-68181850e6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:31 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb705c6-447a-4e88-b0ac-0e5945074a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:31 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Volume a07641ac-409e-422d-aea5-81694b9a016f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a07641ac-409e-422d-aea5-81694b9a016f', 'volume_size': 1} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-00034c17-ef97-4406-a796-7cea5541de67" returned: 0 in 0.534s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-00034c17-ef97-4406-a796-7cea5541de67 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:31 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-00034c17-ef97-4406-a796-7cea5541de67 Sep 25 10:51:31 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:31 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-00034c17-ef97-4406-a796-7cea5541de67" returned: 0 in 0.343s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-00034c17-ef97-4406-a796-7cea5541de67" released by "delete_volume" :: held 0.945s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Created reservations ['91bf6c29-0905-4250-bc7e-9b8a8296fd6e', '254d65eb-0332-43af-905c-7155ece56c46', '2f64ec2b-1eda-4918-8932-70e079cb63a8', '23fe23df-f052-4654-8de2-005bd874db23'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:31 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd 1073741824" returned: 0 in 0.703s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:32 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:51:32 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:32 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd Sep 25 10:51:32 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:32 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.286s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:32 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Deleted volume successfully. Sep 25 10:51:32 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd" returned: 0 in 0.319s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.921s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-513502819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07641ac-409e-422d-aea5-81694b9a016f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3b106a928f47a69f58c303fcd9f135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:31Z,use_quota=True,user_id='029589c21abe41aba5979fb7dacccc2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Creating volume a07641ac-409e-422d-aea5-81694b9a016f {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:32 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b5faa46b-5d73-4154-9d50-e29716e6695e tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-00034c17-ef97-4406-a796-7cea5541de67-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4514f7-8bf7-4740-82e0-16cbf6876cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:32 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f 1073741824 Sep 25 10:51:32 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2139659f-2cc4-47a3-8cf1-14e9a85bb109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:32 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Volume volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd (6e9c56f3-8078-41f9-b358-b3f8f482b5fd): created successfully Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2139659f-2cc4-47a3-8cf1-14e9a85bb109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Flow 'volume_create_manager' (1e17884b-47bb-4181-a884-f2db1b5a154c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:32 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a2bc4dc8-21bd-4063-b053-9f811257d89c tempest-AbsoluteLimitsTests-1712640720 None] Created volume successfully. Sep 25 10:51:32 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f 1073741824" returned: 0 in 0.541s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:32 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f Sep 25 10:51:32 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-82d75251-f7b7-4260-a6f0-6d1f896010c1-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-82d75251-f7b7-4260-a6f0-6d1f896010c1-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-quobyte-82d75251-f7b7-4260-a6f0-6d1f896010c1" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Acquiring lock "cinder-6e9c56f3-8078-41f9-b358-b3f8f482b5fd-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-82d75251-f7b7-4260-a6f0-6d1f896010c1" acquired by "delete_volume" :: waited 0.048s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Lock "cinder-6e9c56f3-8078-41f9-b358-b3f8f482b5fd-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f51e96-f5c7-469b-8d60-39d1964794d5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d75251-f7b7-4260-a6f0-6d1f896010c1 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:33 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f" returned: 0 in 0.569s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Acquiring lock "cinder-quobyte-6e9c56f3-8078-41f9-b358-b3f8f482b5fd" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb705c6-447a-4e88-b0ac-0e5945074a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a07641ac-409e-422d-aea5-81694b9a016f', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102b5b92-69ae-4960-9a67-2fb836529e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Lock "cinder-quobyte-6e9c56f3-8078-41f9-b358-b3f8f482b5fd" acquired by "delete_volume" :: waited 0.055s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:33 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Volume volume-a07641ac-409e-422d-aea5-81694b9a016f (a07641ac-409e-422d-aea5-81694b9a016f): created successfully Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102b5b92-69ae-4960-9a67-2fb836529e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Flow 'volume_create_manager' (6cf5cc19-c7d2-490c-bb4f-d112b52b055f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae2b922-0a83-42b7-85e7-6d1a003f6e46]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:33 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d75251-f7b7-4260-a6f0-6d1f896010c1 Sep 25 10:51:33 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:33 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-3a8e4978-d2f6-44c9-a90c-1d1b1117a0b8 tempest-VolumesDeleteCascade-1977676901 None] Created volume successfully. Sep 25 10:51:33 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd Sep 25 10:51:33 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:34 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d75251-f7b7-4260-a6f0-6d1f896010c1" returned: 0 in 0.658s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d75251-f7b7-4260-a6f0-6d1f896010c1 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:34 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd" returned: 0 in 0.480s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:34 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d75251-f7b7-4260-a6f0-6d1f896010c1 Sep 25 10:51:34 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:34 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd Sep 25 10:51:34 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:34 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d75251-f7b7-4260-a6f0-6d1f896010c1" returned: 0 in 0.371s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-82d75251-f7b7-4260-a6f0-6d1f896010c1" released by "delete_volume" :: held 1.167s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:34 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6e9c56f3-8078-41f9-b358-b3f8f482b5fd" returned: 0 in 0.434s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] Creating offline snapshot aacc1329-34aa-4b00-97be-49e364e8f44a of volume a07641ac-409e-422d-aea5-81694b9a016f {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Lock "cinder-quobyte-6e9c56f3-8078-41f9-b358-b3f8f482b5fd" released by "delete_volume" :: held 0.998s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d5aa49-93f4-4017-94be-06df0ed3385f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Created reservations ['1fe14661-d85f-4413-8374-c5772787efa2', '308a4150-f8f6-4275-8365-8a2e2d6b7227', '0f776fb5-7de5-47f0-8031-53589ecf0abd', 'f00139ae-3d96-4d05-80e3-b5ada1df9cdb'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Created reservations ['83e9c2c9-9da2-439f-9aaa-7e1570a68fdb', 'cb0f495c-33d9-476a-907b-a55b4421f5fa', 'ad48ebc1-9b53-438e-91a9-915326a42088', 'ae41c039-8839-4eae-ba26-0e7f952b88df'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:34 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f Sep 25 10:51:34 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:34 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:34 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:34 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:51:34 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:35 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.366s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:35 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Deleted volume successfully. Sep 25 10:51:35 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f" returned: 0 in 0.609s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:35 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a 1G Sep 25 10:51:35 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-abd5f604-976a-4622-b97e-20fff11cd8c4 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-82d75251-f7b7-4260-a6f0-6d1f896010c1-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:35 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.455s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:35 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Deleted volume successfully. Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-64668707-82b8-4e17-9715-8359682ebda0 tempest-AbsoluteLimitsTests-1712640720 None] Lock "cinder-6e9c56f3-8078-41f9-b358-b3f8f482b5fd-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-1cf9f272-cb63-4872-9a3f-ff1130a50760-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-1cf9f272-cb63-4872-9a3f-ff1130a50760-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-quobyte-29544a76-6a59-41fd-9b7e-b6ba6d95c85f" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-29544a76-6a59-41fd-9b7e-b6ba6d95c85f" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-quobyte-1cf9f272-cb63-4872-9a3f-ff1130a50760" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-1cf9f272-cb63-4872-9a3f-ff1130a50760" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Deleting offline snapshot 1cf9f272-cb63-4872-9a3f-ff1130a50760 of volume 29544a76-6a59-41fd-9b7e-b6ba6d95c85f {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] snapshot_file for this snap is: volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b269f75-c4a7-4aca-8bf8-295e7f5cc037]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:35 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 Sep 25 10:51:35 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:35 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a 1G" returned: 0 in 0.720s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a07641ac-409e-422d-aea5-81694b9a016f -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:36 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a07641ac-409e-422d-aea5-81694b9a016f -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a Sep 25 10:51:36 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:36 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760" returned: 0 in 0.547s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:51:36 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6183e3c-3e09-4f48-a4e5-ceb3d0e6c5a2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:36 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a07641ac-409e-422d-aea5-81694b9a016f -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a" returned: 0 in 0.467s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:36 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a is being set with open permissions: ugo+rw Sep 25 10:51:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:36 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f Sep 25 10:51:36 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:36 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a Sep 25 10:51:36 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:36 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a" returned: 0 in 0.323s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:36 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.info Sep 25 10:51:36 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:36 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f" returned: 0 in 0.626s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:36 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 Sep 25 10:51:36 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:37 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.info" returned: 0 in 0.341s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:37 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.info is being set with open permissions: ugo+rw Sep 25 10:51:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:37 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.info Sep 25 10:51:37 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:37 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760" returned: 0 in 0.544s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:37 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760 Sep 25 10:51:37 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:37 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.info" returned: 0 in 0.450s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.110s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:37 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ee29fe2c-82d7-4786-a629-5d9b82a539e8 tempest-VolumesDeleteCascade-1977676901 None] Create snapshot completed successfully Sep 25 10:51:37 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f.1cf9f272-cb63-4872-9a3f-ff1130a50760" returned: 0 in 0.401s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-1cf9f272-cb63-4872-9a3f-ff1130a50760" released by "_delete_snapshot" :: held 2.309s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-29544a76-6a59-41fd-9b7e-b6ba6d95c85f" released by "delete_snapshot" :: held 2.356s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:38 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Created reservations ['1b7578cd-9dba-42c8-9bea-963d2bf6ecf5', '502316f6-1193-4dae-94e2-3fbd0e94f16d', 'ca9039b0-94f1-4074-a404-23604f6f7afd', 'c2e1d725-e37b-4b76-a69b-d7bf2994d5e1'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:38 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Delete snapshot completed successfully. Sep 25 10:51:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1c354071-7166-4991-a062-bbe0c3916db0 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-1cf9f272-cb63-4872-9a3f-ff1130a50760-delete_snapshot" released by "delete_snapshot" :: held 2.643s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-29544a76-6a59-41fd-9b7e-b6ba6d95c85f-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-29544a76-6a59-41fd-9b7e-b6ba6d95c85f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "cinder-quobyte-29544a76-6a59-41fd-9b7e-b6ba6d95c85f" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-29544a76-6a59-41fd-9b7e-b6ba6d95c85f" acquired by "delete_volume" :: waited 0.036s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:39 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8118ca-d0f2-4901-8e3b-7d9e62115394]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:39 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f Sep 25 10:51:39 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] Creating offline snapshot bc8b5a09-a86c-46c8-8e09-1538bf9acf23 of volume a07641ac-409e-422d-aea5-81694b9a016f {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:51:39 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd37d1f-a22a-41b8-ad49-8dfa50713c6c]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:39 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a Sep 25 10:51:39 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:39 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f" returned: 0 in 0.629s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:39 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f Sep 25 10:51:39 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:40 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-29544a76-6a59-41fd-9b7e-b6ba6d95c85f" returned: 0 in 0.461s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:40 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a" returned: 0 in 0.825s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a07641ac-409e-422d-aea5-81694b9a016f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-quobyte-29544a76-6a59-41fd-9b7e-b6ba6d95c85f" released by "delete_volume" :: held 1.215s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:40 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 1G Sep 25 10:51:40 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Created reservations ['56a63d3f-41e3-4bbc-a88e-1730a9f71d74', '88ae9119-dcc8-41ce-8548-cc5d423aad75', 'db302345-b4c0-437e-8b2c-ec835e9910fc', 'e0f03f0f-1407-43f8-8206-e6af37012b61'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:40 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:51:40 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:40 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.353s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:40 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Deleted volume successfully. Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2f91bcb7-7b5e-499f-bcec-23ef287323f9 tempest-CreateVolumesFromSnapshotTest-1244421644 None] Lock "cinder-29544a76-6a59-41fd-9b7e-b6ba6d95c85f-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:40 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 1G" returned: 0 in 0.700s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:40 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 Sep 25 10:51:40 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:41 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23" returned: 0 in 0.445s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:41 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 is being set with open permissions: ugo+rw Sep 25 10:51:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:41 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 Sep 25 10:51:41 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:41 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23" returned: 0 in 0.363s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.534s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:41 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d8811940-7889-43bd-a2d4-6515c454e645 tempest-VolumesDeleteCascade-1977676901 None] Create snapshot completed successfully Sep 25 10:51:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-a07641ac-409e-422d-aea5-81694b9a016f-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-a07641ac-409e-422d-aea5-81694b9a016f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Performing cascade delete. {{(pid=86874) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 10:51:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-aacc1329-34aa-4b00-97be-49e364e8f44a-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-aacc1329-34aa-4b00-97be-49e364e8f44a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-quobyte-a07641ac-409e-422d-aea5-81694b9a016f" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-a07641ac-409e-422d-aea5-81694b9a016f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-quobyte-aacc1329-34aa-4b00-97be-49e364e8f44a" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-aacc1329-34aa-4b00-97be-49e364e8f44a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Deleting offline snapshot aacc1329-34aa-4b00-97be-49e364e8f44a of volume a07641ac-409e-422d-aea5-81694b9a016f {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:51:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] snapshot_file for this snap is: volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:51:42 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1520630f-6908-4d20-975a-158f379fc242]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:43 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a Sep 25 10:51:43 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:43 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a" returned: 0 in 0.560s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a07641ac-409e-422d-aea5-81694b9a016f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:51:43 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[41836417-473d-4c29-a1ae-435dd882ebc0]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:43 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f Sep 25 10:51:43 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:43 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Flow 'volume_create_manager' (48fed644-a287-43d8-a817-19ed14cf5f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c11272-e46d-411e-9534-c03b3fe87a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c11272-e46d-411e-9534-c03b3fe87a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-77139667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943a2746-2369-4ae0-aab4-6b19fd4c2bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13effc0f8c7e484da42ada762bacb3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:44Z,use_quota=True,user_id='d2602479bc8f402999899de44361d08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d23ea54-7d2c-42b7-8fde-ec0bcc84f3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d23ea54-7d2c-42b7-8fde-ec0bcc84f3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bfe630e-d4f3-4908-946a-74293616db2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bfe630e-d4f3-4908-946a-74293616db2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943a2746-2369-4ae0-aab4-6b19fd4c2bf8', 'volume_name': 'volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78582a29-a358-4989-8484-2fb67c82e91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78582a29-a358-4989-8484-2fb67c82e91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05be8ea-2b50-489f-aa01-d93be910865b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:44 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Volume 943a2746-2369-4ae0-aab4-6b19fd4c2bf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8', 'volume_size': 1} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-77139667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943a2746-2369-4ae0-aab4-6b19fd4c2bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13effc0f8c7e484da42ada762bacb3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:44Z,use_quota=True,user_id='d2602479bc8f402999899de44361d08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Creating volume 943a2746-2369-4ae0-aab4-6b19fd4c2bf8 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:44 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:44 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:44 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8 1073741824 Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f" returned: 0 in 0.640s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:44 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d2ca9e-ad8d-4e63-88cd-02d55b0bc7da]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:44 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 Sep 25 10:51:44 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:44 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23" returned: 0 in 0.506s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a07641ac-409e-422d-aea5-81694b9a016f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:51:44 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8 1073741824" returned: 0 in 0.630s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc8ff8b-4fe4-4040-bf0d-843aa9f42112]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:44 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8 Sep 25 10:51:44 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:44 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a Sep 25 10:51:44 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:45 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8" returned: 0 in 0.435s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:51:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:45 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05be8ea-2b50-489f-aa01-d93be910865b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82a25f7-ab47-4311-932e-ecc8b69ca2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a" returned: 0 in 0.563s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a07641ac-409e-422d-aea5-81694b9a016f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:51:45 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Volume volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8 (943a2746-2369-4ae0-aab4-6b19fd4c2bf8): created successfully Sep 25 10:51:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82a25f7-ab47-4311-932e-ecc8b69ca2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Flow 'volume_create_manager' (48fed644-a287-43d8-a817-19ed14cf5f05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:45 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[38754e2a-9476-486e-bfaf-19d5eb3ec10d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:45 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8aac18c4-da2f-4c6d-b427-b5fcd770723d tempest-VolumesMetadataTest-777611689 None] Created volume successfully. Sep 25 10:51:45 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f Sep 25 10:51:45 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:45 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f" returned: 0 in 0.450s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:45 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a Sep 25 10:51:45 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:46 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a" returned: 0 in 0.500s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:46 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a Sep 25 10:51:46 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:46 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.aacc1329-34aa-4b00-97be-49e364e8f44a" returned: 0 in 0.442s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a07641ac-409e-422d-aea5-81694b9a016f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 -F qcow2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:46 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a07641ac-409e-422d-aea5-81694b9a016f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 -F qcow2 Sep 25 10:51:46 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:47 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a07641ac-409e-422d-aea5-81694b9a016f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 -F qcow2" returned: 0 in 0.507s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-aacc1329-34aa-4b00-97be-49e364e8f44a" released by "_delete_snapshot" :: held 4.505s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-a07641ac-409e-422d-aea5-81694b9a016f" released by "delete_snapshot" :: held 4.549s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Created reservations ['31665e11-cd52-4cb1-8760-ba0257067d07', 'c531b7ee-3627-486d-af50-ec75f4a2a340', 'd1696c04-dfdb-4211-bc51-7e4c2bd642bc', '8fa6e709-fabd-43e2-bce8-cf26c2551b01'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:47 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Delete snapshot completed successfully. Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-aacc1329-34aa-4b00-97be-49e364e8f44a-delete_snapshot" released by "delete_snapshot" :: held 4.895s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-bc8b5a09-a86c-46c8-8e09-1538bf9acf23-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-bc8b5a09-a86c-46c8-8e09-1538bf9acf23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Acquiring lock "cinder-943a2746-2369-4ae0-aab4-6b19fd4c2bf8-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-quobyte-a07641ac-409e-422d-aea5-81694b9a016f" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Lock "cinder-943a2746-2369-4ae0-aab4-6b19fd4c2bf8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-a07641ac-409e-422d-aea5-81694b9a016f" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-quobyte-bc8b5a09-a86c-46c8-8e09-1538bf9acf23" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-bc8b5a09-a86c-46c8-8e09-1538bf9acf23" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Deleting offline snapshot bc8b5a09-a86c-46c8-8e09-1538bf9acf23 of volume a07641ac-409e-422d-aea5-81694b9a016f {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] snapshot_file for this snap is: volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Acquiring lock "cinder-quobyte-943a2746-2369-4ae0-aab4-6b19fd4c2bf8" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[226915ae-ba8f-4cad-afe4-4c912d5a7509]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Lock "cinder-quobyte-943a2746-2369-4ae0-aab4-6b19fd4c2bf8" acquired by "delete_volume" :: waited 0.038s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96cb36d-7632-4dd8-9b97-1bd13e96aa89]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:48 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 Sep 25 10:51:48 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:48 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8 Sep 25 10:51:48 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:48 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8" returned: 0 in 0.488s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:48 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23" returned: 0 in 0.576s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a07641ac-409e-422d-aea5-81694b9a016f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:51:48 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8 Sep 25 10:51:48 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:48 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c0adec-05bc-464e-ac90-c3710a014273]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:48 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f Sep 25 10:51:48 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:48 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-943a2746-2369-4ae0-aab4-6b19fd4c2bf8" returned: 0 in 0.412s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:48 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Lock "cinder-quobyte-943a2746-2369-4ae0-aab4-6b19fd4c2bf8" released by "delete_volume" :: held 1.011s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:48 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Flow 'volume_create_manager' (85890e04-f953-40a8-a1ec-be32289c1c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19c52cc-d122-4ff1-83d3-6c7c58d1daac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19c52cc-d122-4ff1-83d3-6c7c58d1daac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-368149989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb2f075-0207-44d4-b392-d9e58e300f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185f7ae16ef44d4f87f788723982cb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:49Z,use_quota=True,user_id='5a5b6241ec724257acd4065c5fe5f398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9be15228-c2da-4875-acc2-c4b242ddda51),volume_type_id=9be15228-c2da-4875-acc2-c4b242ddda51)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7090defa-7713-4254-8ea7-658048967626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7090defa-7713-4254-8ea7-658048967626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb6f68c-7d90-4c51-8353-2aab9983d160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb6f68c-7d90-4c51-8353-2aab9983d160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceb2f075-0207-44d4-b392-d9e58e300f2a', 'volume_name': 'volume-ceb2f075-0207-44d4-b392-d9e58e300f2a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865a0c21-d730-4f58-8404-1b842fa1c640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865a0c21-d730-4f58-8404-1b842fa1c640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd71f9bf-510a-4ccc-9674-793d3a182c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:49 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Volume ceb2f075-0207-44d4-b392-d9e58e300f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceb2f075-0207-44d4-b392-d9e58e300f2a', 'volume_size': 1} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-368149989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb2f075-0207-44d4-b392-d9e58e300f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185f7ae16ef44d4f87f788723982cb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:49Z,use_quota=True,user_id='5a5b6241ec724257acd4065c5fe5f398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9be15228-c2da-4875-acc2-c4b242ddda51),volume_type_id=9be15228-c2da-4875-acc2-c4b242ddda51)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Creating volume ceb2f075-0207-44d4-b392-d9e58e300f2a {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:49 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ceb2f075-0207-44d4-b392-d9e58e300f2a 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:49 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f" returned: 0 in 0.617s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:49 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ceb2f075-0207-44d4-b392-d9e58e300f2a 1073741824 Sep 25 10:51:49 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Created reservations ['f7f106a3-2bca-46e6-a6bf-c580ac4f33fb', 'a7a61af0-878d-4124-92f8-d8b8ace06386', 'c72e0326-bae3-46da-b344-28781ca35749', 'eb78782e-06c8-4e47-be49-7bf46c0846db'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:49 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 Sep 25 10:51:49 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:49 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:51:49 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Flow 'volume_create_manager' (fa38fcb7-b43e-4ed3-a52d-21bf3030225e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82269f00-a7b4-48ab-bdcd-c4afb5f021e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82269f00-a7b4-48ab-bdcd-c4afb5f021e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1393542200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e3c66a-b926-4cf0-8475-960022d6a959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185f7ae16ef44d4f87f788723982cb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:50Z,use_quota=True,user_id='5a5b6241ec724257acd4065c5fe5f398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f0ebc25-78f1-4bc7-9bcf-3dd63bbdf8cd),volume_type_id=9f0ebc25-78f1-4bc7-9bcf-3dd63bbdf8cd)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a08e73-2b00-422f-aaab-765c015a1e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a08e73-2b00-422f-aaab-765c015a1e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ad149e-b8fd-459d-988e-ef42b59db12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ad149e-b8fd-459d-988e-ef42b59db12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95e3c66a-b926-4cf0-8475-960022d6a959', 'volume_name': 'volume-95e3c66a-b926-4cf0-8475-960022d6a959', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55079f4a-9b7c-4d93-9b5f-ba034e5a97a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55079f4a-9b7c-4d93-9b5f-ba034e5a97a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b23967c-06df-4e1f-ab0d-74b6281e89ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:49 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Volume 95e3c66a-b926-4cf0-8475-960022d6a959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95e3c66a-b926-4cf0-8475-960022d6a959', 'volume_size': 1} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:49 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23" returned: 0 in 0.605s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:49 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23 Sep 25 10:51:49 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:49 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.522s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:49 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:49 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Deleted volume successfully. Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ceb2f075-0207-44d4-b392-d9e58e300f2a 1073741824" returned: 0 in 0.767s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ea7bf4b0-0f99-49d2-ba31-7f8364d3b769 tempest-VolumesMetadataTest-777611689 None] Lock "cinder-943a2746-2369-4ae0-aab4-6b19fd4c2bf8-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ceb2f075-0207-44d4-b392-d9e58e300f2a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:49 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ceb2f075-0207-44d4-b392-d9e58e300f2a Sep 25 10:51:49 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:50 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f.bc8b5a09-a86c-46c8-8e09-1538bf9acf23" returned: 0 in 0.456s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-bc8b5a09-a86c-46c8-8e09-1538bf9acf23" released by "_delete_snapshot" :: held 2.471s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-a07641ac-409e-422d-aea5-81694b9a016f" released by "delete_snapshot" :: held 2.509s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:50 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ceb2f075-0207-44d4-b392-d9e58e300f2a" returned: 0 in 0.405s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1393542200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e3c66a-b926-4cf0-8475-960022d6a959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185f7ae16ef44d4f87f788723982cb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:50Z,use_quota=True,user_id='5a5b6241ec724257acd4065c5fe5f398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f0ebc25-78f1-4bc7-9bcf-3dd63bbdf8cd),volume_type_id=9f0ebc25-78f1-4bc7-9bcf-3dd63bbdf8cd)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Creating volume 95e3c66a-b926-4cf0-8475-960022d6a959 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:50 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-95e3c66a-b926-4cf0-8475-960022d6a959 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd71f9bf-510a-4ccc-9674-793d3a182c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceb2f075-0207-44d4-b392-d9e58e300f2a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:50 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-95e3c66a-b926-4cf0-8475-960022d6a959 1073741824 Sep 25 10:51:50 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cba50ac-8923-481d-ba2e-eb42b5b81df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:50 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Volume volume-ceb2f075-0207-44d4-b392-d9e58e300f2a (ceb2f075-0207-44d4-b392-d9e58e300f2a): created successfully Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cba50ac-8923-481d-ba2e-eb42b5b81df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Flow 'volume_create_manager' (85890e04-f953-40a8-a1ec-be32289c1c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:50 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-dfbcbcec-d83d-46c6-b756-65322aa18c8c tempest-TestInstancesWithCinderVolumes-344012517 None] Created volume successfully. Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Created reservations ['2677a6da-a3cb-4330-b35a-e435f5ad7ef2', '3f5568a4-6b13-4292-ab5f-4f125643bdab', 'db880ff6-091e-4dd3-9b1a-a0247abd2747', 'ddae4826-b6c0-4e8d-9d0c-5e60e435ce70'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:50 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Delete snapshot completed successfully. Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-bc8b5a09-a86c-46c8-8e09-1538bf9acf23-delete_snapshot" released by "delete_snapshot" :: held 2.913s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Snapshots deleted, issuing volume delete {{(pid=86874) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-quobyte-a07641ac-409e-422d-aea5-81694b9a016f" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-a07641ac-409e-422d-aea5-81694b9a016f" acquired by "delete_volume" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e9aba0-c60a-4121-a2fb-3dddcf5bada0]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:50 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f Sep 25 10:51:50 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:51 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-95e3c66a-b926-4cf0-8475-960022d6a959 1073741824" returned: 0 in 0.802s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Flow 'volume_create_manager' (ca616d7f-dd35-492e-892e-c23febee40d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd706be-d49a-44fa-a197-180daa3573f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd706be-d49a-44fa-a197-180daa3573f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1363204370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0961b34-4fb4-447a-8d5f-23d511bd8808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185f7ae16ef44d4f87f788723982cb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:51Z,use_quota=True,user_id='5a5b6241ec724257acd4065c5fe5f398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d4e1ffb-fdff-42fe-949d-56ebacf41e00),volume_type_id=9d4e1ffb-fdff-42fe-949d-56ebacf41e00)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21aa9de9-09ff-4636-8477-4e080872d987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21aa9de9-09ff-4636-8477-4e080872d987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094155b1-6607-40f5-9fd7-c554f6feabf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG cinder.image.glance [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Creating Keystone auth plugin from conf {{(pid=86874) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-95e3c66a-b926-4cf0-8475-960022d6a959 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:51 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-95e3c66a-b926-4cf0-8475-960022d6a959 Sep 25 10:51:51 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:51 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f" returned: 0 in 0.806s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:51 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f Sep 25 10:51:51 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:51 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-95e3c66a-b926-4cf0-8475-960022d6a959" returned: 0 in 0.416s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b23967c-06df-4e1f-ab0d-74b6281e89ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e3c66a-b926-4cf0-8475-960022d6a959', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e198ed-00e0-4219-bec5-547da706c3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:51 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Volume volume-95e3c66a-b926-4cf0-8475-960022d6a959 (95e3c66a-b926-4cf0-8475-960022d6a959): created successfully Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e198ed-00e0-4219-bec5-547da706c3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Flow 'volume_create_manager' (fa38fcb7-b43e-4ed3-a52d-21bf3030225e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:51 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a07641ac-409e-422d-aea5-81694b9a016f" returned: 0 in 0.444s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:51 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-df6b96a1-86db-47bd-9ace-87efd99ccd53 tempest-TestInstancesWithCinderVolumes-344012517 None] Created volume successfully. Sep 25 10:51:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-a07641ac-409e-422d-aea5-81694b9a016f" released by "delete_volume" :: held 1.366s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=166,cinder:UPDATE=188,cinder:INSERT=53,cinder:DELETE=21 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Created reservations ['29b72e33-cb31-4608-b623-0d22fcfa8e89', 'b4dc7a02-b7d2-4e31-8bda-81700b318003', '290f27ff-b5ed-4359-8a07-4c02cd63f87d', 'c1b4a1e0-7811-47a8-89a9-a2e19894d738'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094155b1-6607-40f5-9fd7-c554f6feabf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b0961b34-4fb4-447a-8d5f-23d511bd8808', 'volume_name': 'volume-b0961b34-4fb4-447a-8d5f-23d511bd8808', 'volume_size': 1, 'image_id': 'd30d581b-e30e-410c-ba54-d2e3bb940069', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d30d581b-e30e-410c-ba54-d2e3bb940069', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--909246319', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '185f7ae16ef44d4f87f788723982cb05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd30d581b-e30e-410c-ba54-d2e3bb940069', 'created_at': datetime.datetime(2026, 9, 25, 8, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d30d581b-e30e-410c-ba54-d2e3bb940069/file', 'properties': {}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380fba96-7fff-4df3-89a9-ec92c77baca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380fba96-7fff-4df3-89a9-ec92c77baca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c636fa3d-1340-42b3-9092-fb97ce025d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:52 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Volume b0961b34-4fb4-447a-8d5f-23d511bd8808: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b0961b34-4fb4-447a-8d5f-23d511bd8808', 'volume_size': 1, 'image_id': 'd30d581b-e30e-410c-ba54-d2e3bb940069', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d30d581b-e30e-410c-ba54-d2e3bb940069', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--909246319', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '185f7ae16ef44d4f87f788723982cb05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd30d581b-e30e-410c-ba54-d2e3bb940069', 'created_at': datetime.datetime(2026, 9, 25, 8, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d30d581b-e30e-410c-ba54-d2e3bb940069/file', 'properties': {}}, 'image_service': } Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Trying to clone b0961b34-4fb4-447a-8d5f-23d511bd8808 from image d30d581b-e30e-410c-ba54-d2e3bb940069 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d30d581b-e30e-410c-ba54-d2e3bb940069', 'metadata': {}}]). {{(pid=86874) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:52 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:51:52 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:52 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.491s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:52 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Deleted volume successfully. Sep 25 10:51:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c01d4e0f-4297-4a29-9dbd-0fdd3568afa2 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-a07641ac-409e-422d-aea5-81694b9a016f-delete_volume" released by "delete_volume" :: held 10.262s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Flow 'volume_create_manager' (054d4225-8c41-4606-8bd9-5047b9802d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e066dcd-2d06-41d6-9720-c98f6b8c1fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e066dcd-2d06-41d6-9720-c98f6b8c1fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1440650167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae48d45-45d3-4a9d-9cb6-e52d99332c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3b106a928f47a69f58c303fcd9f135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:54Z,use_quota=True,user_id='029589c21abe41aba5979fb7dacccc2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eecf3130-3e22-4dc0-a7a7-3c48c821d4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eecf3130-3e22-4dc0-a7a7-3c48c821d4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea90377-b1b2-4e05-a8da-c9ccbed594d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea90377-b1b2-4e05-a8da-c9ccbed594d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae48d45-45d3-4a9d-9cb6-e52d99332c9d', 'volume_name': 'volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d3353e-9bc2-4405-acae-03fa3e2aa14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d3353e-9bc2-4405-acae-03fa3e2aa14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0332093-57e1-441b-95f5-568c6bd46a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:54 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Volume bae48d45-45d3-4a9d-9cb6-e52d99332c9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d', 'volume_size': 1} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1440650167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae48d45-45d3-4a9d-9cb6-e52d99332c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3b106a928f47a69f58c303fcd9f135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:54Z,use_quota=True,user_id='029589c21abe41aba5979fb7dacccc2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Creating volume bae48d45-45d3-4a9d-9cb6-e52d99332c9d {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:54 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:51:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:54 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d 1073741824 Sep 25 10:51:54 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:55 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d 1073741824" returned: 0 in 0.769s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:55 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d Sep 25 10:51:55 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:55 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d" returned: 0 in 0.440s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:51:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0332093-57e1-441b-95f5-568c6bd46a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529a3c3d-5ea9-4ae4-81a8-ed9dc5a36d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:55 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Volume volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d (bae48d45-45d3-4a9d-9cb6-e52d99332c9d): created successfully Sep 25 10:51:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529a3c3d-5ea9-4ae4-81a8-ed9dc5a36d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Flow 'volume_create_manager' (054d4225-8c41-4606-8bd9-5047b9802d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:55 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-65756211-0722-4613-93a6-df000a30a105 tempest-VolumesDeleteCascade-1977676901 None] Created volume successfully. Sep 25 10:51:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] Creating offline snapshot a86b5932-729e-4ccc-9357-759331afad0d of volume bae48d45-45d3-4a9d-9cb6-e52d99332c9d {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:51:56 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[851d7575-1dec-4187-9ac2-875d8ed74bcc]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:56 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d Sep 25 10:51:56 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:57 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d" returned: 0 in 0.622s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:57 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d 1G Sep 25 10:51:57 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:57 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d30d581b-e30e-410c-ba54-d2e3bb940069_g2dymuvsdevstack@QuobyteHD, size 20.69 MB, duration 5.47 sec {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:51:57 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Image download 20.69 MB at 3.78 MB/s Sep 25 10:51:57 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dc229d-d9d6-4d96-a1e3-c1035a21b325]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d30d581b-e30e-410c-ba54-d2e3bb940069_g2dymuvsdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:57 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d30d581b-e30e-410c-ba54-d2e3bb940069_g2dymuvsdevstack@QuobyteHD Sep 25 10:51:57 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:57 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d 1G" returned: 0 in 0.678s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:58 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d Sep 25 10:51:58 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:58 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d30d581b-e30e-410c-ba54-d2e3bb940069_g2dymuvsdevstack@QuobyteHD" returned: 0 in 0.525s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Temporary image d30d581b-e30e-410c-ba54-d2e3bb940069 is fetched for user 5a5b6241ec724257acd4065c5fe5f398. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be95f9b-126a-412d-9818-c84279a6ebfd]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d30d581b-e30e-410c-ba54-d2e3bb940069_g2dymuvsdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:58 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d" returned: 0 in 0.454s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:58 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d is being set with open permissions: ugo+rw Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:58 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d Sep 25 10:51:58 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:58 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d30d581b-e30e-410c-ba54-d2e3bb940069_g2dymuvsdevstack@QuobyteHD Sep 25 10:51:58 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Flow 'volume_create_manager' (a79d61e6-e4f9-4526-83df-6123a2bb8de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68c8945-bd96-432b-a64b-a0d9d62a5ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68c8945-bd96-432b-a64b-a0d9d62a5ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-715591699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33bce10-760b-4b44-8569-fb432ed89d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa2b35efdbf4c64a424081b7578ba93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:59Z,use_quota=True,user_id='7132bd737e544455b9f11cf975e81fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c95d9b5-a829-4734-b91c-1ad407a610b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:58 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c95d9b5-a829-4734-b91c-1ad407a610b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69af44e0-9963-439f-84b9-fa41539d4f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69af44e0-9963-439f-84b9-fa41539d4f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b33bce10-760b-4b44-8569-fb432ed89d7e', 'volume_name': 'volume-b33bce10-760b-4b44-8569-fb432ed89d7e', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81aa04f-f624-4e7f-8f2b-55a214acc648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81aa04f-f624-4e7f-8f2b-55a214acc648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248a3c75-7e84-4b36-bac2-eec3eef20d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:58 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Volume b33bce10-760b-4b44-8569-fb432ed89d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b33bce10-760b-4b44-8569-fb432ed89d7e', 'volume_size': 1} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d" returned: 0 in 0.498s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:58 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d30d581b-e30e-410c-ba54-d2e3bb940069_g2dymuvsdevstack@QuobyteHD" returned: 0 in 0.555s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:59 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.info Sep 25 10:51:59 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:59 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.info" returned: 0 in 0.305s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:59 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.info is being set with open permissions: ugo+rw Sep 25 10:51:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:59 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.info Sep 25 10:51:59 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:59 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.info" returned: 0 in 0.322s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.030s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.710s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-715591699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33bce10-760b-4b44-8569-fb432ed89d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa2b35efdbf4c64a424081b7578ba93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:59Z,use_quota=True,user_id='7132bd737e544455b9f11cf975e81fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:51:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Creating volume b33bce10-760b-4b44-8569-fb432ed89d7e {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:59 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:51:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b33bce10-760b-4b44-8569-fb432ed89d7e 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:59 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b33bce10-760b-4b44-8569-fb432ed89d7e 1073741824 Sep 25 10:51:59 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:59 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6b0e13d2-1b24-408f-bc4c-6d1dc7944a8f tempest-VolumesDeleteCascade-1977676901 None] Create snapshot completed successfully Sep 25 10:52:00 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b33bce10-760b-4b44-8569-fb432ed89d7e 1073741824" returned: 0 in 0.558s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b33bce10-760b-4b44-8569-fb432ed89d7e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:00 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b33bce10-760b-4b44-8569-fb432ed89d7e Sep 25 10:52:00 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:52:00 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b33bce10-760b-4b44-8569-fb432ed89d7e" returned: 0 in 0.404s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.714s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1363204370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0961b34-4fb4-447a-8d5f-23d511bd8808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185f7ae16ef44d4f87f788723982cb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:51Z,use_quota=True,user_id='5a5b6241ec724257acd4065c5fe5f398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d4e1ffb-fdff-42fe-949d-56ebacf41e00),volume_type_id=9d4e1ffb-fdff-42fe-949d-56ebacf41e00)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Creating volume b0961b34-4fb4-447a-8d5f-23d511bd8808 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:00 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Flow 'volume_create_manager' (6945a611-17d0-418e-a7f0-359cb10f3d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:00 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 1073741824 Sep 25 10:52:00 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c683c38-a114-4ee4-bb2e-b89c666f1f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248a3c75-7e84-4b36-bac2-eec3eef20d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b33bce10-760b-4b44-8569-fb432ed89d7e', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473649fe-6501-4730-8fd2-5812fb9398f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c683c38-a114-4ee4-bb2e-b89c666f1f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-832545659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e12759-9a7a-43c3-8b05-429b4aba2e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3b106a928f47a69f58c303fcd9f135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a86b5932-729e-4ccc-9357-759331afad0d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:01Z,use_quota=True,user_id='029589c21abe41aba5979fb7dacccc2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db99d0ca-6453-43cd-a617-0e46b104cba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db99d0ca-6453-43cd-a617-0e46b104cba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d263a6ac-87c0-46b6-aff9-4f378631c42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d263a6ac-87c0-46b6-aff9-4f378631c42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '64e12759-9a7a-43c3-8b05-429b4aba2e7e', 'volume_name': 'volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e', 'volume_size': 1, 'snapshot_id': 'a86b5932-729e-4ccc-9357-759331afad0d'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af9f885-9f00-4fa8-a327-6d2d96ae8185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af9f885-9f00-4fa8-a327-6d2d96ae8185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93f9bb2-f8a7-4da5-b309-63d592566224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:00 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Volume 64e12759-9a7a-43c3-8b05-429b4aba2e7e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e', 'volume_size': 1, 'snapshot_id': 'a86b5932-729e-4ccc-9357-759331afad0d'} Sep 25 10:52:00 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Volume volume-b33bce10-760b-4b44-8569-fb432ed89d7e (b33bce10-760b-4b44-8569-fb432ed89d7e): created successfully Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473649fe-6501-4730-8fd2-5812fb9398f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Flow 'volume_create_manager' (a79d61e6-e4f9-4526-83df-6123a2bb8de7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:00 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-858c7f37-316e-4ee2-a6d2-b43994488ede tempest-VolumesTransfersV357Test-1619198488 None] Created volume successfully. Sep 25 10:52:01 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 1073741824" returned: 0 in 0.576s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:01 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 Sep 25 10:52:01 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:01 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808" returned: 0 in 0.303s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.713s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-quobyte-a86b5932-729e-4ccc-9357-759331afad0d-64e12759-9a7a-43c3-8b05-429b4aba2e7e" by "_create_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-a86b5932-729e-4ccc-9357-759331afad0d-64e12759-9a7a-43c3-8b05-429b4aba2e7e" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Creating volume 64e12759-9a7a-43c3-8b05-429b4aba2e7e from snapshot a86b5932-729e-4ccc-9357-759331afad0d {{(pid=86874) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-quobyte-64e12759-9a7a-43c3-8b05-429b4aba2e7e" by "_copy_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Attempting download of d30d581b-e30e-410c-ba54-d2e3bb940069 ((None, [{'url': 'file:///opt/stack/data/glance/images/d30d581b-e30e-410c-ba54-d2e3bb940069', 'metadata': {}}])) to volume b0961b34-4fb4-447a-8d5f-23d511bd8808. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-64e12759-9a7a-43c3-8b05-429b4aba2e7e" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] snapshot: a86b5932-729e-4ccc-9357-759331afad0d, volume: 64e12759-9a7a-43c3-8b05-429b4aba2e7e, {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b80f5af-1513-4fb6-a990-56e1c20c5791]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[313bf809-ae39-45ab-9773-cdeb6ddc8205]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d30d581b-e30e-410c-ba54-d2e3bb940069_m9qzw_bs {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:01 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d30d581b-e30e-410c-ba54-d2e3bb940069_m9qzw_bs Sep 25 10:52:01 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:02 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d Sep 25 10:52:02 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:02 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d" returned: 0 in 0.628s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:02 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:52:02 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fef0b1-8c8e-4640-bde6-51d5eac20765]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:02 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d30d581b-e30e-410c-ba54-d2e3bb940069_m9qzw_bs" returned: 0 in 0.669s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d30d581b-e30e-410c-ba54-d2e3bb940069_m9qzw_bs {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:02 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d Sep 25 10:52:02 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:02 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d30d581b-e30e-410c-ba54-d2e3bb940069_m9qzw_bs Sep 25 10:52:02 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:03 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d30d581b-e30e-410c-ba54-d2e3bb940069_m9qzw_bs" returned: 1 in 0.526s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d30d581b-e30e-410c-ba54-d2e3bb940069_m9qzw_bs' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:52:03 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9afa873-f3af-4082-8fb7-a2834289cadf]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d30d581b-e30e-410c-ba54-d2e3bb940069_g2dymuvsdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:03 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d" returned: 0 in 0.603s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] will copy from snapshot at /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:52:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Creating direct copy from snapshot {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:52:03 devstack cinder-volume[86874]: DEBUG cinder.utils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Path /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e not found in is_blk_device check {{(pid=86874) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 10:52:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:03 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e Sep 25 10:52:03 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:03 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d30d581b-e30e-410c-ba54-d2e3bb940069_g2dymuvsdevstack@QuobyteHD Sep 25 10:52:03 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:03 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-49a7aa6b-a9e9-4d12-894d-6e5f89128d36 tempest-VolumesTransfersV357Test-1836100351 None] Transfer volume completed successfully. Sep 25 10:52:03 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d30d581b-e30e-410c-ba54-d2e3bb940069_g2dymuvsdevstack@QuobyteHD" returned: 0 in 0.577s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:03 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] d30d581b-e30e-410c-ba54-d2e3bb940069 was qcow2, converting to qcow2 {{(pid=86874) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:52:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d30d581b-e30e-410c-ba54-d2e3bb940069_g2dymuvsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:03 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d30d581b-e30e-410c-ba54-d2e3bb940069_g2dymuvsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 Sep 25 10:52:03 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Acquiring lock "cinder-b33bce10-760b-4b44-8569-fb432ed89d7e-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Lock "cinder-b33bce10-760b-4b44-8569-fb432ed89d7e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Acquiring lock "cinder-quobyte-b33bce10-760b-4b44-8569-fb432ed89d7e" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Lock "cinder-quobyte-b33bce10-760b-4b44-8569-fb432ed89d7e" acquired by "delete_volume" :: waited 0.033s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:04 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc0bf12-892f-49d2-9f5a-282a6c8756d3]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b33bce10-760b-4b44-8569-fb432ed89d7e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:05 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b33bce10-760b-4b44-8569-fb432ed89d7e Sep 25 10:52:05 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:05 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b33bce10-760b-4b44-8569-fb432ed89d7e" returned: 0 in 0.977s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b33bce10-760b-4b44-8569-fb432ed89d7e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:05 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b33bce10-760b-4b44-8569-fb432ed89d7e Sep 25 10:52:05 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:06 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b33bce10-760b-4b44-8569-fb432ed89d7e" returned: 0 in 0.401s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:06 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Lock "cinder-quobyte-b33bce10-760b-4b44-8569-fb432ed89d7e" released by "delete_volume" :: held 1.514s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:06 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Created reservations ['83e58d9d-ee97-40cb-ae1c-01c2626ad63e', 'c666f650-c231-4f89-bc78-801e614b558b', '2063a922-a735-412a-9414-3c608c2e37ca', '1e54374a-00a7-4387-8caa-cf148705cfea'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:06 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:52:06 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:07 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.734s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:07 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:07 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Deleted volume successfully. Sep 25 10:52:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc790c78-f4c2-43ad-9c6c-f4b9933453d7 tempest-VolumesTransfersV357Test-2139491030 None] Lock "cinder-b33bce10-760b-4b44-8569-fb432ed89d7e-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:08 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:52:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Flow 'volume_create_manager' (f944b086-b734-4a8c-ae53-6e6c74ecee7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0479543-0b5e-4601-8ccd-80d37912e5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0479543-0b5e-4601-8ccd-80d37912e5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1453452103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc19a98-409a-40b1-b641-e2e95dc64034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa2b35efdbf4c64a424081b7578ba93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:08Z,use_quota=True,user_id='7132bd737e544455b9f11cf975e81fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf52b43-688c-4103-9e0d-7a3377b30847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf52b43-688c-4103-9e0d-7a3377b30847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08209ff-8651-4eff-a6fe-c2ed7fa25b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08209ff-8651-4eff-a6fe-c2ed7fa25b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc19a98-409a-40b1-b641-e2e95dc64034', 'volume_name': 'volume-8cc19a98-409a-40b1-b641-e2e95dc64034', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded608cb-cbd2-491f-9e17-6503caf64d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded608cb-cbd2-491f-9e17-6503caf64d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96baf453-29ef-4320-b014-334cc9ef8007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:08 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Volume 8cc19a98-409a-40b1-b641-e2e95dc64034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc19a98-409a-40b1-b641-e2e95dc64034', 'volume_size': 1} Sep 25 10:52:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:10 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d30d581b-e30e-410c-ba54-d2e3bb940069_g2dymuvsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808" returned: 0 in 6.548s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:10 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d30d581b-e30e-410c-ba54-d2e3bb940069_g2dymuvsdevstack@QuobyteHD, size 112.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:52:10 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Converted 112.00 MB image at 17.10 MB/s Sep 25 10:52:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:10 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 1G Sep 25 10:52:10 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:11 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 1G" returned: 0 in 0.889s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:11 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Downloaded image d30d581b-e30e-410c-ba54-d2e3bb940069 ((None, [{'url': 'file:///opt/stack/data/glance/images/d30d581b-e30e-410c-ba54-d2e3bb940069', 'metadata': {}}])) to volume b0961b34-4fb4-447a-8d5f-23d511bd8808 successfully. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 10:52:11 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Temporary image d30d581b-e30e-410c-ba54-d2e3bb940069 for user 5a5b6241ec724257acd4065c5fe5f398 is deleted. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:52:11 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Marking volume b0961b34-4fb4-447a-8d5f-23d511bd8808 as bootable. {{(pid=86874) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 10:52:11 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Copying metadata from image d30d581b-e30e-410c-ba54-d2e3bb940069 to b0961b34-4fb4-447a-8d5f-23d511bd8808. {{(pid=86874) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:52:11 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Creating volume glance metadata for volume b0961b34-4fb4-447a-8d5f-23d511bd8808 backed by image d30d581b-e30e-410c-ba54-d2e3bb940069 with: {'image_id': 'd30d581b-e30e-410c-ba54-d2e3bb940069', 'image_name': 'tempest-scenario-img--909246319', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86874) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:52:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c636fa3d-1340-42b3-9092-fb97ce025d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0961b34-4fb4-447a-8d5f-23d511bd8808', 'volume_size': 1, 'image_id': 'd30d581b-e30e-410c-ba54-d2e3bb940069', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d30d581b-e30e-410c-ba54-d2e3bb940069', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--909246319', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '185f7ae16ef44d4f87f788723982cb05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd30d581b-e30e-410c-ba54-d2e3bb940069', 'created_at': datetime.datetime(2026, 9, 25, 8, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d30d581b-e30e-410c-ba54-d2e3bb940069/file', 'properties': {}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6409da7-52d8-4fc6-b5ec-992eb2b70766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:11 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Volume volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 (b0961b34-4fb4-447a-8d5f-23d511bd8808): created successfully Sep 25 10:52:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6409da7-52d8-4fc6-b5ec-992eb2b70766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Flow 'volume_create_manager' (ca616d7f-dd35-492e-892e-c23febee40d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:11 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ca6ff306-e85d-4bd1-8c45-c81965c0b14e tempest-TestInstancesWithCinderVolumes-344012517 None] Created volume successfully. Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e" returned: 0 in 9.455s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d, size 1024.00 MB, duration 9.46 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:52:12 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Converted 1024.00 MB image at 108.29 MB/s Sep 25 10:52:12 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e is being set with open permissions: ugo+rw Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:12 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e Sep 25 10:52:12 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:12 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e" returned: 0 in 0.297s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-64e12759-9a7a-43c3-8b05-429b4aba2e7e" released by "_copy_volume_from_snapshot" :: held 11.132s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-a86b5932-729e-4ccc-9357-759331afad0d-64e12759-9a7a-43c3-8b05-429b4aba2e7e" released by "_create_volume_from_snapshot" :: held 11.231s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.261s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.218s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1453452103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc19a98-409a-40b1-b641-e2e95dc64034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa2b35efdbf4c64a424081b7578ba93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:08Z,use_quota=True,user_id='7132bd737e544455b9f11cf975e81fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Creating volume 8cc19a98-409a-40b1-b641-e2e95dc64034 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:12 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:52:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8cc19a98-409a-40b1-b641-e2e95dc64034 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:12 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8cc19a98-409a-40b1-b641-e2e95dc64034 1073741824 Sep 25 10:52:12 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93f9bb2-f8a7-4da5-b309-63d592566224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e', 'volume_size': 1, 'snapshot_id': 'a86b5932-729e-4ccc-9357-759331afad0d'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580a1ed8-f6fc-4f1b-b36d-15910d576fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:13 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Volume volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e (64e12759-9a7a-43c3-8b05-429b4aba2e7e): created successfully Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580a1ed8-f6fc-4f1b-b36d-15910d576fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Flow 'volume_create_manager' (6945a611-17d0-418e-a7f0-359cb10f3d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-dcb4d1f5-b4a0-4e25-9fac-b0741caaba03 tempest-VolumesDeleteCascade-1977676901 None] Created volume successfully. Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-bae48d45-45d3-4a9d-9cb6-e52d99332c9d-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-bae48d45-45d3-4a9d-9cb6-e52d99332c9d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Performing cascade delete. {{(pid=86874) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-a86b5932-729e-4ccc-9357-759331afad0d-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-a86b5932-729e-4ccc-9357-759331afad0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-quobyte-bae48d45-45d3-4a9d-9cb6-e52d99332c9d" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-bae48d45-45d3-4a9d-9cb6-e52d99332c9d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-quobyte-a86b5932-729e-4ccc-9357-759331afad0d" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-a86b5932-729e-4ccc-9357-759331afad0d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Deleting offline snapshot a86b5932-729e-4ccc-9357-759331afad0d of volume bae48d45-45d3-4a9d-9cb6-e52d99332c9d {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] snapshot_file for this snap is: volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[601302d2-929f-41f8-893d-ca8221e6c418]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:13 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8cc19a98-409a-40b1-b641-e2e95dc64034 1073741824" returned: 0 in 0.777s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8cc19a98-409a-40b1-b641-e2e95dc64034 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:13 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8cc19a98-409a-40b1-b641-e2e95dc64034 Sep 25 10:52:13 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:13 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d Sep 25 10:52:13 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:14 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8cc19a98-409a-40b1-b641-e2e95dc64034" returned: 0 in 0.452s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:52:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96baf453-29ef-4320-b014-334cc9ef8007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc19a98-409a-40b1-b641-e2e95dc64034', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dadacb5-258e-4c41-a8db-886f98c23c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:14 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Volume volume-8cc19a98-409a-40b1-b641-e2e95dc64034 (8cc19a98-409a-40b1-b641-e2e95dc64034): created successfully Sep 25 10:52:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dadacb5-258e-4c41-a8db-886f98c23c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Flow 'volume_create_manager' (f944b086-b734-4a8c-ae53-6e6c74ecee7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:14 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d" returned: 0 in 0.670s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:52:14 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-17673b42-3d52-4269-b47f-f91045cadabe tempest-VolumesTransfersV357Test-1619198488 None] Created volume successfully. Sep 25 10:52:14 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d05afa-9c0c-4576-a27a-72850dee52dd]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:14 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d Sep 25 10:52:14 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:15 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d" returned: 0 in 0.769s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:15 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d Sep 25 10:52:15 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:15 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d" returned: 0 in 0.640s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:15 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d Sep 25 10:52:15 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Acquiring lock "cinder-8cc19a98-409a-40b1-b641-e2e95dc64034-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Lock "cinder-8cc19a98-409a-40b1-b641-e2e95dc64034-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-82d73073-a18a-4c72-9001-f27c3c681cb6 req-a6cefe81-df19-4699-a1c4-e4333867a0b2 tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-82d73073-a18a-4c72-9001-f27c3c681cb6 req-a6cefe81-df19-4699-a1c4-e4333867a0b2 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=170,cinder:SELECT=119,cinder:INSERT=44,cinder:DELETE=13 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-82d73073-a18a-4c72-9001-f27c3c681cb6 req-a6cefe81-df19-4699-a1c4-e4333867a0b2 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Acquiring lock "cinder-quobyte-8cc19a98-409a-40b1-b641-e2e95dc64034" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:16 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d.a86b5932-729e-4ccc-9357-759331afad0d" returned: 0 in 0.503s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Lock "cinder-quobyte-8cc19a98-409a-40b1-b641-e2e95dc64034" acquired by "delete_volume" :: waited 0.052s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-82d73073-a18a-4c72-9001-f27c3c681cb6 req-a6cefe81-df19-4699-a1c4-e4333867a0b2 tempest-TestInstancesWithCinderVolumes-344012517 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-b0961b34-4fb4-447a-8d5f-23d511bd8808', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d4f8897-3021-44d2-8ee5-bd84b357815d', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-a86b5932-729e-4ccc-9357-759331afad0d" released by "_delete_snapshot" :: held 2.753s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb83904-9b15-440a-ab29-a78fb5bcb22f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8cc19a98-409a-40b1-b641-e2e95dc64034 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-bae48d45-45d3-4a9d-9cb6-e52d99332c9d" released by "delete_snapshot" :: held 2.808s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-82d73073-a18a-4c72-9001-f27c3c681cb6 req-a6cefe81-df19-4699-a1c4-e4333867a0b2 tempest-TestInstancesWithCinderVolumes-344012517 None] attachment_update completed successfully. Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Created reservations ['d0712a0a-592e-461c-bbdb-49bd80ce1330', '459bd42b-ea17-4952-93e2-7a249d8d3516', '1c7d1c10-62a1-4a48-a01b-2227aedba206', 'b2015768-bd99-46a8-aa33-6f3a1a6668ef'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:16 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8cc19a98-409a-40b1-b641-e2e95dc64034 Sep 25 10:52:16 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Delete snapshot completed successfully. Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-a86b5932-729e-4ccc-9357-759331afad0d-delete_snapshot" released by "delete_snapshot" :: held 3.106s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Snapshots deleted, issuing volume delete {{(pid=86874) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-quobyte-bae48d45-45d3-4a9d-9cb6-e52d99332c9d" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-bae48d45-45d3-4a9d-9cb6-e52d99332c9d" acquired by "delete_volume" :: waited 0.036s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dae57f2-493d-4f35-ba2f-a8c882570f79]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:17 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8cc19a98-409a-40b1-b641-e2e95dc64034" returned: 0 in 0.639s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8cc19a98-409a-40b1-b641-e2e95dc64034 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:17 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8cc19a98-409a-40b1-b641-e2e95dc64034 Sep 25 10:52:17 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:17 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d Sep 25 10:52:17 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:17 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8cc19a98-409a-40b1-b641-e2e95dc64034" returned: 0 in 0.455s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:17 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d" returned: 0 in 0.694s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Lock "cinder-quobyte-8cc19a98-409a-40b1-b641-e2e95dc64034" released by "delete_volume" :: held 1.178s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:17 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d Sep 25 10:52:17 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Created reservations ['e23b5345-9fe5-4e00-895f-2eb308d23cd0', '84555659-d440-40db-9bfc-56a70a50d485', '0404b1d0-1508-4189-916e-be8947f6040f', '1e44e80f-7696-4c5d-a59b-93bc5ade3e72'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:17 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:52:17 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:17 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bae48d45-45d3-4a9d-9cb6-e52d99332c9d" returned: 0 in 0.345s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-bae48d45-45d3-4a9d-9cb6-e52d99332c9d" released by "delete_volume" :: held 1.189s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:18 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Created reservations ['6083b544-f078-41f5-90d5-8a01b6974db4', '535d4e69-36b9-4911-bc1c-058c804180e0', '6a490208-8461-4996-81a4-100e6c434410', '1eac9caa-0bf1-49ef-921a-3ef258ba535e'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:18 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.442s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:18 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:18 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:52:18 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Deleted volume successfully. Sep 25 10:52:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-78ab7e14-43ae-4947-b708-b6c1a2697e6f tempest-VolumesTransfersV357Test-2139491030 None] Lock "cinder-8cc19a98-409a-40b1-b641-e2e95dc64034-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:18 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.364s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:18 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Deleted volume successfully. Sep 25 10:52:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47c8c276-50ef-4fa1-b9b7-a7fd7577c522 tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-bae48d45-45d3-4a9d-9cb6-e52d99332c9d-delete_volume" released by "delete_volume" :: held 5.076s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-64e12759-9a7a-43c3-8b05-429b4aba2e7e-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-64e12759-9a7a-43c3-8b05-429b4aba2e7e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "cinder-quobyte-64e12759-9a7a-43c3-8b05-429b4aba2e7e" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-64e12759-9a7a-43c3-8b05-429b4aba2e7e" acquired by "delete_volume" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:19 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15faeda-546b-44ce-aa62-948f2dcf0104]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:19 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e Sep 25 10:52:19 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:20 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e" returned: 0 in 0.613s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:20 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e Sep 25 10:52:20 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:20 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-64e12759-9a7a-43c3-8b05-429b4aba2e7e" returned: 0 in 0.532s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-quobyte-64e12759-9a7a-43c3-8b05-429b4aba2e7e" released by "delete_volume" :: held 1.267s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:20 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Created reservations ['59d881a9-e220-45d3-80ce-2843baaf0255', '80a89288-e6bf-4f8a-bec0-0fa49273996f', '9ca977b8-3c4c-4c5a-89f7-4d6e526d043a', 'e4e003d8-31b7-494e-87bc-4c90aa60f6d1'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:21 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:52:21 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:21 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.619s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:21 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:21 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Deleted volume successfully. Sep 25 10:52:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a63925b0-a68d-4e68-9e6c-a4ba595dfa3a tempest-VolumesDeleteCascade-1977676901 None] Lock "cinder-64e12759-9a7a-43c3-8b05-429b4aba2e7e-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:52:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:26 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:52:26 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:26 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.520s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:52:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:52:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:52:31 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=57,cinder:UPDATE=60,cinder:DELETE=6,cinder:INSERT=21 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:52:31 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=26,cinder:SELECT=19,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Flow 'volume_create_manager' (c64d8119-97b9-4dc5-b583-ccceac63e99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b188425e-f8a0-4d6c-8f76-da6d0d04c70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b188425e-f8a0-4d6c-8f76-da6d0d04c70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1000795214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400e7304-67a2-4408-93bc-50f8501e2633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a032ba365c814518bbd22a35c5ba7aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:33Z,use_quota=True,user_id='09b6e40c08ab4e39ab64ecb4f63af2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65cea8e-50e7-4085-b455-41c8a134cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65cea8e-50e7-4085-b455-41c8a134cda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5891470a-d1be-44eb-a8f4-55f0a7bd0dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5891470a-d1be-44eb-a8f4-55f0a7bd0dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '400e7304-67a2-4408-93bc-50f8501e2633', 'volume_name': 'volume-400e7304-67a2-4408-93bc-50f8501e2633', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41dcc1d-6407-412f-b548-1e2da8b133df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41dcc1d-6407-412f-b548-1e2da8b133df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc876f8-461b-44ec-98c2-b9de3193f394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:33 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Volume 400e7304-67a2-4408-93bc-50f8501e2633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-400e7304-67a2-4408-93bc-50f8501e2633', 'volume_size': 1} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1000795214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400e7304-67a2-4408-93bc-50f8501e2633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a032ba365c814518bbd22a35c5ba7aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:33Z,use_quota=True,user_id='09b6e40c08ab4e39ab64ecb4f63af2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Creating volume 400e7304-67a2-4408-93bc-50f8501e2633 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:33 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:52:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:33 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 1073741824 Sep 25 10:52:33 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:34 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 1073741824" returned: 0 in 0.902s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:34 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 Sep 25 10:52:34 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:35 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633" returned: 0 in 0.547s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:52:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc876f8-461b-44ec-98c2-b9de3193f394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-400e7304-67a2-4408-93bc-50f8501e2633', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae01fac-4b83-4e74-a634-661df69d3d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:35 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Volume volume-400e7304-67a2-4408-93bc-50f8501e2633 (400e7304-67a2-4408-93bc-50f8501e2633): created successfully Sep 25 10:52:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae01fac-4b83-4e74-a634-661df69d3d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Flow 'volume_create_manager' (c64d8119-97b9-4dc5-b583-ccceac63e99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:35 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5ed06a7e-0630-4e75-9321-995b73121696 tempest-SnapshotDependencyTests-837452026 None] Created volume successfully. Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] Creating offline snapshot 360fdefc-da9f-4315-bf31-56663974312a of volume 400e7304-67a2-4408-93bc-50f8501e2633 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c211cc77-0131-4f89-b5f2-d21aa1b69f0f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Flow 'volume_create_manager' (ea17d091-90a6-4a5a-ab0a-20011f790c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93ee49d-b9da-49fd-9ded-e6e49b9fe71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93ee49d-b9da-49fd-9ded-e6e49b9fe71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-840877483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac796af0-e5c3-4c45-a232-a823db5d5b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38adee4be3914ba59b0e24ca33e3870b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:36Z,use_quota=True,user_id='7d6c843efa87499895b6cd4f13d12140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2560acf-c98d-43cf-b746-8a1f0cee6484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2560acf-c98d-43cf-b746-8a1f0cee6484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ecf4dd-1cdf-4d8b-8e40-95da248f1b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ecf4dd-1cdf-4d8b-8e40-95da248f1b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac796af0-e5c3-4c45-a232-a823db5d5b5e', 'volume_name': 'volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec38f02-499e-4192-8b2c-7f6adc54adbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec38f02-499e-4192-8b2c-7f6adc54adbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:36 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa88bc0b-d23e-419a-a6a0-f5317adac7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:36 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Volume ac796af0-e5c3-4c45-a232-a823db5d5b5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e', 'volume_size': 1} Sep 25 10:52:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:36 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:37 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633" returned: 0 in 0.725s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:37 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a 1G Sep 25 10:52:37 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:38 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a 1G" returned: 0 in 0.820s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400e7304-67a2-4408-93bc-50f8501e2633 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:38 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400e7304-67a2-4408-93bc-50f8501e2633 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a Sep 25 10:52:38 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:38 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400e7304-67a2-4408-93bc-50f8501e2633 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a" returned: 0 in 0.642s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:38 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a is being set with open permissions: ugo+rw Sep 25 10:52:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:38 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a Sep 25 10:52:38 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:39 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a" returned: 0 in 0.413s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:39 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.info Sep 25 10:52:39 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:39 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.info" returned: 0 in 0.479s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:39 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.info is being set with open permissions: ugo+rw Sep 25 10:52:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:39 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.info Sep 25 10:52:39 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:40 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.info" returned: 0 in 0.571s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.837s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.447s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-840877483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac796af0-e5c3-4c45-a232-a823db5d5b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38adee4be3914ba59b0e24ca33e3870b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:36Z,use_quota=True,user_id='7d6c843efa87499895b6cd4f13d12140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:52:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Creating volume ac796af0-e5c3-4c45-a232-a823db5d5b5e {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:52:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:40 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:52:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:40 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e 1073741824 Sep 25 10:52:40 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:40 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-08956957-d066-4c64-bc20-9566a92a14a9 tempest-SnapshotDependencyTests-837452026 None] Create snapshot completed successfully Sep 25 10:52:41 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e 1073741824" returned: 0 in 0.767s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:41 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e Sep 25 10:52:41 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:41 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e" returned: 0 in 0.636s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:52:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa88bc0b-d23e-419a-a6a0-f5317adac7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93e475e-d73e-4bed-9498-46c3061afa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:41 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Volume volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e (ac796af0-e5c3-4c45-a232-a823db5d5b5e): created successfully Sep 25 10:52:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93e475e-d73e-4bed-9498-46c3061afa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Flow 'volume_create_manager' (ea17d091-90a6-4a5a-ab0a-20011f790c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:41 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-9d10a868-ede1-481a-a5ed-95814e8dc32a tempest-VolumesTransfersTest-991924654 None] Created volume successfully. Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Flow 'volume_create_manager' (eda3600c-582a-4ad3-ad66-05b1645593c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86d6f84-22a5-4783-86cb-2f51cbbb297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86d6f84-22a5-4783-86cb-2f51cbbb297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c52d3f5-7f8e-439d-af19-0f8a3aef4813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a032ba365c814518bbd22a35c5ba7aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=360fdefc-da9f-4315-bf31-56663974312a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:42Z,use_quota=True,user_id='09b6e40c08ab4e39ab64ecb4f63af2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f3d0f8-7a9e-42f6-9143-d4e02c16150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f3d0f8-7a9e-42f6-9143-d4e02c16150c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30fab261-aa0e-4814-9adb-c3a04d875015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30fab261-aa0e-4814-9adb-c3a04d875015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c52d3f5-7f8e-439d-af19-0f8a3aef4813', 'volume_name': 'volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813', 'volume_size': 1, 'snapshot_id': '360fdefc-da9f-4315-bf31-56663974312a'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2729e8ab-275d-4473-98ec-84ad11806289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2729e8ab-275d-4473-98ec-84ad11806289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e78c28-0df4-4b2b-b67a-cbd7bff2af3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:42 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Volume 8c52d3f5-7f8e-439d-af19-0f8a3aef4813: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813', 'volume_size': 1, 'snapshot_id': '360fdefc-da9f-4315-bf31-56663974312a'} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "cinder-quobyte-360fdefc-da9f-4315-bf31-56663974312a-8c52d3f5-7f8e-439d-af19-0f8a3aef4813" by "_create_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-quobyte-360fdefc-da9f-4315-bf31-56663974312a-8c52d3f5-7f8e-439d-af19-0f8a3aef4813" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Creating volume 8c52d3f5-7f8e-439d-af19-0f8a3aef4813 from snapshot 360fdefc-da9f-4315-bf31-56663974312a {{(pid=86874) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "cinder-quobyte-8c52d3f5-7f8e-439d-af19-0f8a3aef4813" by "_copy_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-quobyte-8c52d3f5-7f8e-439d-af19-0f8a3aef4813" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] snapshot: 360fdefc-da9f-4315-bf31-56663974312a, volume: 8c52d3f5-7f8e-439d-af19-0f8a3aef4813, {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1872cda3-5363-4256-a666-5cc9e9366f9e]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:42 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a Sep 25 10:52:42 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:42 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a" returned: 0 in 0.641s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-400e7304-67a2-4408-93bc-50f8501e2633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:52:43 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efbaf72-2c25-404e-86ab-f7d28e3d24d2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:43 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 Sep 25 10:52:43 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:43 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633" returned: 0 in 0.750s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] will copy from snapshot at /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:52:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Creating direct copy from snapshot {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:52:43 devstack cinder-volume[86874]: DEBUG cinder.utils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Path /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813 not found in is_blk_device check {{(pid=86874) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 10:52:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:43 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813 Sep 25 10:52:43 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:44 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-46d6b606-ef71-45db-a3fa-4b637b88f3d6 tempest-VolumesTransfersTest-75683711 None] Transfer volume completed successfully. Sep 25 10:52:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Acquiring lock "cinder-ac796af0-e5c3-4c45-a232-a823db5d5b5e-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Lock "cinder-ac796af0-e5c3-4c45-a232-a823db5d5b5e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Acquiring lock "cinder-quobyte-ac796af0-e5c3-4c45-a232-a823db5d5b5e" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Lock "cinder-quobyte-ac796af0-e5c3-4c45-a232-a823db5d5b5e" acquired by "delete_volume" :: waited 0.062s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:46 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09d5385-f975-4425-9368-52d6173f15d9]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:47 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e Sep 25 10:52:47 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:47 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e" returned: 0 in 0.822s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:47 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e Sep 25 10:52:47 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:48 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ac796af0-e5c3-4c45-a232-a823db5d5b5e" returned: 0 in 0.934s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:48 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Lock "cinder-quobyte-ac796af0-e5c3-4c45-a232-a823db5d5b5e" released by "delete_volume" :: held 1.903s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:48 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Created reservations ['08c36d9f-11b9-4f2c-b2e4-3679bfb500a4', '06e4ef8e-365e-4e38-b305-32a7a38bc97a', '6144fb9f-6465-4d98-9f85-b341887fc0a9', 'cc4285d6-4c12-4380-ad39-2dcbbb59ec45'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:49 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:52:49 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:49 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.520s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:49 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:49 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Deleted volume successfully. Sep 25 10:52:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a440724b-722a-48da-87be-f1d16cb7ae06 tempest-VolumesTransfersTest-731255862 None] Lock "cinder-ac796af0-e5c3-4c45-a232-a823db5d5b5e-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:51 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:52:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Flow 'volume_create_manager' (1ccd37af-ed19-4c7e-aa5a-f786b5d28152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609d78bf-4ac4-4609-9128-5541a96589e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609d78bf-4ac4-4609-9128-5541a96589e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-334479569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77b8b76-2d27-4369-b712-2eeb39a61240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38adee4be3914ba59b0e24ca33e3870b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:52Z,use_quota=True,user_id='7d6c843efa87499895b6cd4f13d12140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699b1d54-e352-4337-b1e1-78a617cc3910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699b1d54-e352-4337-b1e1-78a617cc3910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cbf813-7978-408b-b838-4223787349c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cbf813-7978-408b-b838-4223787349c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a77b8b76-2d27-4369-b712-2eeb39a61240', 'volume_name': 'volume-a77b8b76-2d27-4369-b712-2eeb39a61240', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5541b62e-ae03-4ba2-b877-80a95677efa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5541b62e-ae03-4ba2-b877-80a95677efa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70d3055-ea5d-49f4-8bd5-abc096b3c2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:52 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Volume a77b8b76-2d27-4369-b712-2eeb39a61240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a77b8b76-2d27-4369-b712-2eeb39a61240', 'volume_size': 1} Sep 25 10:52:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:54 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813" returned: 0 in 10.754s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:54 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633, size 1024.00 MB, duration 10.75 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:52:54 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Converted 1024.00 MB image at 95.21 MB/s Sep 25 10:52:54 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813 is being set with open permissions: ugo+rw Sep 25 10:52:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:54 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813 Sep 25 10:52:54 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:54 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813" returned: 0 in 0.427s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:54 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-quobyte-8c52d3f5-7f8e-439d-af19-0f8a3aef4813" released by "_copy_volume_from_snapshot" :: held 12.714s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-quobyte-360fdefc-da9f-4315-bf31-56663974312a-8c52d3f5-7f8e-439d-af19-0f8a3aef4813" released by "_create_volume_from_snapshot" :: held 12.940s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.965s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.021s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-334479569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77b8b76-2d27-4369-b712-2eeb39a61240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38adee4be3914ba59b0e24ca33e3870b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:52Z,use_quota=True,user_id='7d6c843efa87499895b6cd4f13d12140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Creating volume a77b8b76-2d27-4369-b712-2eeb39a61240 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:55 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a77b8b76-2d27-4369-b712-2eeb39a61240 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:55 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a77b8b76-2d27-4369-b712-2eeb39a61240 1073741824 Sep 25 10:52:55 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e78c28-0df4-4b2b-b67a-cbd7bff2af3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813', 'volume_size': 1, 'snapshot_id': '360fdefc-da9f-4315-bf31-56663974312a'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4042c7f8-8a83-4ab6-a060-a8b8b2685b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:55 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Volume volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813 (8c52d3f5-7f8e-439d-af19-0f8a3aef4813): created successfully Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4042c7f8-8a83-4ab6-a060-a8b8b2685b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Flow 'volume_create_manager' (eda3600c-582a-4ad3-ad66-05b1645593c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:55 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-22682c7a-a0ad-49fa-afc7-3fb6a56eb815 tempest-SnapshotDependencyTests-837452026 None] Created volume successfully. Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "cinder-360fdefc-da9f-4315-bf31-56663974312a-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:55 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:52:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Flow 'volume_create_manager' (652c9ded-f89d-492a-81e2-a1a8b8c8e148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394f9ea8-7582-4a41-b288-ffcda7194133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-360fdefc-da9f-4315-bf31-56663974312a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.089s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "cinder-quobyte-400e7304-67a2-4408-93bc-50f8501e2633" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a77b8b76-2d27-4369-b712-2eeb39a61240 1073741824" returned: 0 in 0.813s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394f9ea8-7582-4a41-b288-ffcda7194133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1952018006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8d9e86-3c20-442a-863b-f9e87ab5bc97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd8fc163566474d8550a7a8c00cc85c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:56Z,use_quota=True,user_id='559adaf678b24ae2ba133860e9269317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc68c34-f9aa-4b59-b284-1a415016b992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc68c34-f9aa-4b59-b284-1a415016b992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78dfb569-1bfa-4c94-bdb6-dcf8722b98c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78dfb569-1bfa-4c94-bdb6-dcf8722b98c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee8d9e86-3c20-442a-863b-f9e87ab5bc97', 'volume_name': 'volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047b57d1-2a0d-4fd0-b7f1-fb4b49a95d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047b57d1-2a0d-4fd0-b7f1-fb4b49a95d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859236ba-cc40-47cc-ae4d-3c7c4c39d272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:56 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Volume ee8d9e86-3c20-442a-863b-f9e87ab5bc97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97', 'volume_size': 1} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-quobyte-400e7304-67a2-4408-93bc-50f8501e2633" acquired by "delete_snapshot" :: waited 0.100s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "cinder-quobyte-360fdefc-da9f-4315-bf31-56663974312a" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-quobyte-360fdefc-da9f-4315-bf31-56663974312a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Deleting offline snapshot 360fdefc-da9f-4315-bf31-56663974312a of volume 400e7304-67a2-4408-93bc-50f8501e2633 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] snapshot_file for this snap is: volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a77b8b76-2d27-4369-b712-2eeb39a61240 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8f0d1a-a881-4e08-a564-dc9fb7cd9ecd]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:56 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a77b8b76-2d27-4369-b712-2eeb39a61240 Sep 25 10:52:56 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:56 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a Sep 25 10:52:56 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:56 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a77b8b76-2d27-4369-b712-2eeb39a61240" returned: 0 in 0.348s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.423s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1952018006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8d9e86-3c20-442a-863b-f9e87ab5bc97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd8fc163566474d8550a7a8c00cc85c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:56Z,use_quota=True,user_id='559adaf678b24ae2ba133860e9269317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Creating volume ee8d9e86-3c20-442a-863b-f9e87ab5bc97 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:56 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70d3055-ea5d-49f4-8bd5-abc096b3c2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a77b8b76-2d27-4369-b712-2eeb39a61240', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba6f5ad-9c63-42d2-86f3-2153949cb299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:56 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 1073741824 Sep 25 10:52:56 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:56 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Volume volume-a77b8b76-2d27-4369-b712-2eeb39a61240 (a77b8b76-2d27-4369-b712-2eeb39a61240): created successfully Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba6f5ad-9c63-42d2-86f3-2153949cb299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Flow 'volume_create_manager' (1ccd37af-ed19-4c7e-aa5a-f786b5d28152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:56 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f159bc71-1a04-4e80-9788-dc45f557ed9f tempest-VolumesTransfersTest-991924654 None] Created volume successfully. Sep 25 10:52:56 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a" returned: 0 in 0.578s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-400e7304-67a2-4408-93bc-50f8501e2633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfac895-5035-42b9-9385-6756b039b1f7]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:56 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 Sep 25 10:52:56 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:57 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 1073741824" returned: 0 in 0.697s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:57 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 Sep 25 10:52:57 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:57 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633" returned: 0 in 0.677s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:57 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a Sep 25 10:52:57 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:57 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Acquiring lock "cinder-a77b8b76-2d27-4369-b712-2eeb39a61240-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" returned: 0 in 0.369s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Lock "cinder-a77b8b76-2d27-4369-b712-2eeb39a61240-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859236ba-cc40-47cc-ae4d-3c7c4c39d272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80dc811e-d617-4ee2-a818-3e34def2a1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:57 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Volume volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 (ee8d9e86-3c20-442a-863b-f9e87ab5bc97): created successfully Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80dc811e-d617-4ee2-a818-3e34def2a1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Flow 'volume_create_manager' (652c9ded-f89d-492a-81e2-a1a8b8c8e148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:57 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-27722aa5-f2c4-473b-951a-19a70162b66f tempest-VolumesActionsTest-2104349504 None] Created volume successfully. Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Acquiring lock "cinder-quobyte-a77b8b76-2d27-4369-b712-2eeb39a61240" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Lock "cinder-quobyte-a77b8b76-2d27-4369-b712-2eeb39a61240" acquired by "delete_volume" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3451a29a-e198-456b-b1ee-ed5276dce2dd]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a77b8b76-2d27-4369-b712-2eeb39a61240 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:57 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a" returned: 0 in 0.471s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:57 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a77b8b76-2d27-4369-b712-2eeb39a61240 Sep 25 10:52:57 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:58 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a Sep 25 10:52:58 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:58 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633.360fdefc-da9f-4315-bf31-56663974312a" returned: 0 in 0.333s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:58 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a77b8b76-2d27-4369-b712-2eeb39a61240" returned: 0 in 0.498s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a77b8b76-2d27-4369-b712-2eeb39a61240 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:58 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a77b8b76-2d27-4369-b712-2eeb39a61240 Sep 25 10:52:58 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-quobyte-360fdefc-da9f-4315-bf31-56663974312a" released by "_delete_snapshot" :: held 2.270s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-quobyte-400e7304-67a2-4408-93bc-50f8501e2633" released by "delete_snapshot" :: held 2.312s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Created reservations ['cb176441-c8b6-47a3-aff7-0ef99fcfc90b', 'bbb5a973-efb6-495f-a735-b571306ba621', 'ae04d24d-fb5e-41b2-9675-7d822cb5839f', '1d50b51c-3db6-4afd-b4e4-2677e1e3211b'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:58 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Delete snapshot completed successfully. Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53b15ea9-63cd-4664-a51d-4765be0aab03 tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-360fdefc-da9f-4315-bf31-56663974312a-delete_snapshot" released by "delete_snapshot" :: held 2.594s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:58 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a77b8b76-2d27-4369-b712-2eeb39a61240" returned: 0 in 0.338s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Lock "cinder-quobyte-a77b8b76-2d27-4369-b712-2eeb39a61240" released by "delete_volume" :: held 0.889s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Created reservations ['86c9d3bf-8d96-4d77-abe7-c1202382ad10', '1d72a11c-ebf1-445d-a890-b868a139fe61', '416ab55f-dfd6-4e41-9c3d-8ad32e6c4eec', 'fc7edb91-2b32-4f75-93f1-22b942411d45'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:58 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:52:58 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "cinder-400e7304-67a2-4408-93bc-50f8501e2633-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:59 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-400e7304-67a2-4408-93bc-50f8501e2633-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.340s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:59 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Deleted volume successfully. Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "cinder-quobyte-400e7304-67a2-4408-93bc-50f8501e2633" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-06432dc6-ce60-4328-a851-83cdcaaa197b tempest-VolumesTransfersTest-731255862 None] Lock "cinder-a77b8b76-2d27-4369-b712-2eeb39a61240-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-quobyte-400e7304-67a2-4408-93bc-50f8501e2633" acquired by "delete_volume" :: waited 0.042s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb13c21d-3c0a-4862-a359-56921e3c4f71]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:59 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 Sep 25 10:52:59 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-d013ef2b-36b5-43e9-a30a-252ef3df8336 req-500f0ac0-3d84-489f-af33-270eae7442ff tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-d013ef2b-36b5-43e9-a30a-252ef3df8336 req-500f0ac0-3d84-489f-af33-270eae7442ff tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-d013ef2b-36b5-43e9-a30a-252ef3df8336 req-500f0ac0-3d84-489f-af33-270eae7442ff tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-d013ef2b-36b5-43e9-a30a-252ef3df8336 req-500f0ac0-3d84-489f-af33-270eae7442ff tempest-TestInstancesWithCinderVolumes-344012517 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-ceb2f075-0207-44d4-b392-d9e58e300f2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '277ef262-1cd9-4e9a-966d-20449a9ebe14', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:52:59 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-d013ef2b-36b5-43e9-a30a-252ef3df8336 req-500f0ac0-3d84-489f-af33-270eae7442ff tempest-TestInstancesWithCinderVolumes-344012517 None] attachment_update completed successfully. Sep 25 10:52:59 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633" returned: 0 in 0.488s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:00 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633 Sep 25 10:53:00 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:00 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-400e7304-67a2-4408-93bc-50f8501e2633" returned: 0 in 0.406s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-quobyte-400e7304-67a2-4408-93bc-50f8501e2633" released by "delete_volume" :: held 1.015s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:00 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Created reservations ['e56574bc-c67a-4bd9-a9b4-dd70eca0fdc5', 'edf7bd5e-b258-47c9-bac7-8f599bc4814e', '6d8b45fd-f928-4dbf-be1b-e7b967469042', 'ecf04e88-6ba8-447f-b8c5-af451bc5687b'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:00 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:53:00 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:01 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.337s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:01 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:01 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Deleted volume successfully. Sep 25 10:53:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c71f269d-6369-44f9-ba42-811ce114469e tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-400e7304-67a2-4408-93bc-50f8501e2633-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "cinder-8c52d3f5-7f8e-439d-af19-0f8a3aef4813-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-8c52d3f5-7f8e-439d-af19-0f8a3aef4813-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "cinder-quobyte-8c52d3f5-7f8e-439d-af19-0f8a3aef4813" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-quobyte-8c52d3f5-7f8e-439d-af19-0f8a3aef4813" acquired by "delete_volume" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:01 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ca5a63-53ce-46a7-b065-eb727cf4f66a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:02 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813 Sep 25 10:53:02 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:02 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813" returned: 0 in 0.746s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:02 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813 Sep 25 10:53:02 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:02 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c52d3f5-7f8e-439d-af19-0f8a3aef4813" returned: 0 in 0.428s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-quobyte-8c52d3f5-7f8e-439d-af19-0f8a3aef4813" released by "delete_volume" :: held 1.269s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Created reservations ['ed4e7e8a-8542-42a6-9ebb-5a1b7668c517', '8afa0be0-b596-4ef4-b40b-40f1c54894a4', 'ab50899e-94d2-4839-8391-38a11d553331', 'd32b0b2a-1c7c-4321-82ba-50c018e3ae02'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:03 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:53:03 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:03 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.415s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:03 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Deleted volume successfully. Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6947de6b-a14a-4f69-a7ff-6804cc707500 tempest-SnapshotDependencyTests-837452026 None] Lock "cinder-8c52d3f5-7f8e-439d-af19-0f8a3aef4813-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-34dfa769-1759-4cc5-842d-372d911cabaa req-770a003e-c6b2-4255-8065-cf49153b14b5 tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-34dfa769-1759-4cc5-842d-372d911cabaa req-770a003e-c6b2-4255-8065-cf49153b14b5 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-34dfa769-1759-4cc5-842d-372d911cabaa req-770a003e-c6b2-4255-8065-cf49153b14b5 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-34dfa769-1759-4cc5-842d-372d911cabaa req-770a003e-c6b2-4255-8065-cf49153b14b5 tempest-TestInstancesWithCinderVolumes-344012517 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-95e3c66a-b926-4cf0-8475-960022d6a959', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '371e2a21-da71-4c73-ade5-fd7313b57153', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:53:04 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-34dfa769-1759-4cc5-842d-372d911cabaa req-770a003e-c6b2-4255-8065-cf49153b14b5 tempest-TestInstancesWithCinderVolumes-344012517 None] attachment_update completed successfully. Sep 25 10:53:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7103fa8d-277e-4640-be2e-f018eda1e0ea tempest-VolumesActionsTest-2104349504 None] Acquiring lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" by "attach_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7103fa8d-277e-4640-be2e-f018eda1e0ea tempest-VolumesActionsTest-2104349504 None] Lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" acquired by "attach_volume" :: waited 0.040s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:12 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7103fa8d-277e-4640-be2e-f018eda1e0ea tempest-VolumesActionsTest-2104349504 None] Attaching volume ee8d9e86-3c20-442a-863b-f9e87ab5bc97 to instance 541e1034-58d2-4079-b72f-278b45e9ada1 at mountpoint /dev/vdb on host None. Sep 25 10:53:12 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7103fa8d-277e-4640-be2e-f018eda1e0ea tempest-VolumesActionsTest-2104349504 None] Attach volume completed successfully. Sep 25 10:53:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7103fa8d-277e-4640-be2e-f018eda1e0ea tempest-VolumesActionsTest-2104349504 None] Lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" released by "attach_volume" :: held 0.184s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bdd0d97a-7885-496a-b716-029ceb99df82 tempest-VolumesActionsTest-2104349504 None] Acquiring lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97-detach_volume" by "detach_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:12 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-80201f2f-947b-4095-8370-47f7cfbbf21c req-bbe88455-813b-410f-b54b-840e33dd8876 tempest-TestInstancesWithCinderVolumes-344012517 None] Terminate volume connection completed successfully. Sep 25 10:53:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-80201f2f-947b-4095-8370-47f7cfbbf21c req-bbe88455-813b-410f-b54b-840e33dd8876 tempest-TestInstancesWithCinderVolumes-344012517 None] Deleting attachment 277ef262-1cd9-4e9a-966d-20449a9ebe14. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:53:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bdd0d97a-7885-496a-b716-029ceb99df82 tempest-VolumesActionsTest-2104349504 None] Lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:12 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bdd0d97a-7885-496a-b716-029ceb99df82 tempest-VolumesActionsTest-2104349504 None] Detaching volume ee8d9e86-3c20-442a-863b-f9e87ab5bc97 from instance 541e1034-58d2-4079-b72f-278b45e9ada1. Sep 25 10:53:12 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bdd0d97a-7885-496a-b716-029ceb99df82 tempest-VolumesActionsTest-2104349504 None] Detach volume completed successfully. Sep 25 10:53:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bdd0d97a-7885-496a-b716-029ceb99df82 tempest-VolumesActionsTest-2104349504 None] Lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97-detach_volume" released by "detach_volume" :: held 0.154s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "cinder-ceb2f075-0207-44d4-b392-d9e58e300f2a-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "cinder-ceb2f075-0207-44d4-b392-d9e58e300f2a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "cinder-quobyte-ceb2f075-0207-44d4-b392-d9e58e300f2a" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "cinder-quobyte-ceb2f075-0207-44d4-b392-d9e58e300f2a" acquired by "delete_volume" :: waited 0.056s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:14 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[595c2d0b-ee49-41c3-ad30-b92566db35b0]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ceb2f075-0207-44d4-b392-d9e58e300f2a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:14 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ceb2f075-0207-44d4-b392-d9e58e300f2a Sep 25 10:53:14 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:15 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ceb2f075-0207-44d4-b392-d9e58e300f2a" returned: 0 in 0.733s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ceb2f075-0207-44d4-b392-d9e58e300f2a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:15 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ceb2f075-0207-44d4-b392-d9e58e300f2a Sep 25 10:53:15 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Flow 'volume_create_manager' (238f155c-a793-402b-a59f-6dd1eb84f10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e003a507-1a33-40fa-8436-1180fdf54377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e003a507-1a33-40fa-8436-1180fdf54377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1765999302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e03267-af04-4bb9-b257-5dd9cd3a880e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26549ecf3dd1402c8b7f1fbc123ee63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:15Z,use_quota=True,user_id='f6833124312b4ae5a79d2da2c892bc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19eb4e4-8ffd-4b20-8fbc-19015fb71118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19eb4e4-8ffd-4b20-8fbc-19015fb71118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efeaa5e7-c117-42d0-9712-30b97366fa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efeaa5e7-c117-42d0-9712-30b97366fa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7e03267-af04-4bb9-b257-5dd9cd3a880e', 'volume_name': 'volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32badea2-e66b-4fb4-ac95-4eccfc37961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32badea2-e66b-4fb4-ac95-4eccfc37961b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c82236-94fe-41e4-886f-56610424e490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:15 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Volume f7e03267-af04-4bb9-b257-5dd9cd3a880e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e', 'volume_size': 1} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1765999302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e03267-af04-4bb9-b257-5dd9cd3a880e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26549ecf3dd1402c8b7f1fbc123ee63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:15Z,use_quota=True,user_id='f6833124312b4ae5a79d2da2c892bc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Creating volume f7e03267-af04-4bb9-b257-5dd9cd3a880e {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:15 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:15 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e 1073741824 Sep 25 10:53:15 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:15 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ceb2f075-0207-44d4-b392-d9e58e300f2a" returned: 0 in 0.404s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "cinder-quobyte-ceb2f075-0207-44d4-b392-d9e58e300f2a" released by "delete_volume" :: held 1.258s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:15 devstack cinder-volume[86874]: WARNING cinder.quota [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-311914788-1358320081 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-311914788-1358320081, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:53:15 devstack cinder-volume[86874]: WARNING cinder.quota [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-311914788-1358320081 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-311914788-1358320081, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Created reservations ['67e92a8d-7a87-41ff-901c-2280e72a9c92', '563d7a24-8419-4edc-b55c-a496f86c2a0e', '749957f1-0cb3-4dab-b5bf-607c314140bb', '684cabb3-5c90-4cfc-bfeb-2b2f73f9046b'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:15 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:53:15 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:16 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:16 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e 1073741824" returned: 0 in 0.779s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.420s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:16 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Deleted volume successfully. Sep 25 10:53:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-00645b7e-8ac0-4632-94ed-51a72ce50506 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "cinder-ceb2f075-0207-44d4-b392-d9e58e300f2a-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:16 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e Sep 25 10:53:16 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:16 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e" returned: 0 in 0.441s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:53:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c82236-94fe-41e4-886f-56610424e490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ab5665-22c2-415a-8698-065d1e3ce16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:16 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Volume volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e (f7e03267-af04-4bb9-b257-5dd9cd3a880e): created successfully Sep 25 10:53:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ab5665-22c2-415a-8698-065d1e3ce16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Flow 'volume_create_manager' (238f155c-a793-402b-a59f-6dd1eb84f10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6bd98902-386a-42f5-b9fc-46813fce1503 tempest-VolumesTransfersV355Test-1950699673 None] Created volume successfully. Sep 25 10:53:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-779ce416-f42a-4537-ae3a-b536dce9d8f6 tempest-VolumesTransfersV355Test-482574391 None] Transfer volume completed successfully. Sep 25 10:53:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Acquiring lock "cinder-f7e03267-af04-4bb9-b257-5dd9cd3a880e-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Lock "cinder-f7e03267-af04-4bb9-b257-5dd9cd3a880e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Acquiring lock "cinder-quobyte-f7e03267-af04-4bb9-b257-5dd9cd3a880e" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Lock "cinder-quobyte-f7e03267-af04-4bb9-b257-5dd9cd3a880e" acquired by "delete_volume" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:19 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e116bb-d7b5-483e-a4ac-1c4454a2ab42]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:19 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e Sep 25 10:53:19 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:19 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-f154704b-be69-4008-a7d4-226b18e688c1 req-5e82aeb7-7aa4-4c7d-aecc-4f6582bcf349 tempest-TestInstancesWithCinderVolumes-344012517 None] Terminate volume connection completed successfully. Sep 25 10:53:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-f154704b-be69-4008-a7d4-226b18e688c1 req-5e82aeb7-7aa4-4c7d-aecc-4f6582bcf349 tempest-TestInstancesWithCinderVolumes-344012517 None] Deleting attachment 371e2a21-da71-4c73-ade5-fd7313b57153. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:53:19 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e" returned: 0 in 0.587s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:19 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e Sep 25 10:53:19 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "cinder-95e3c66a-b926-4cf0-8475-960022d6a959-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "cinder-95e3c66a-b926-4cf0-8475-960022d6a959-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "cinder-quobyte-95e3c66a-b926-4cf0-8475-960022d6a959" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "cinder-quobyte-95e3c66a-b926-4cf0-8475-960022d6a959" acquired by "delete_volume" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:20 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f7e03267-af04-4bb9-b257-5dd9cd3a880e" returned: 0 in 0.423s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Lock "cinder-quobyte-f7e03267-af04-4bb9-b257-5dd9cd3a880e" released by "delete_volume" :: held 1.064s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab994502-73cc-4445-b07f-bc42859e2b7f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-95e3c66a-b926-4cf0-8475-960022d6a959 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Created reservations ['24a4cd80-453a-4dea-86b9-72b57da5152c', '71e0cea2-8230-456a-adfc-bf6f12e7c220', 'fccd466f-eddb-48e2-932a-0225cf92bc21', '326cf982-10f1-4faa-85bb-fbf322c4546e'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:20 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-95e3c66a-b926-4cf0-8475-960022d6a959 Sep 25 10:53:20 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:20 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:53:20 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:21 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-95e3c66a-b926-4cf0-8475-960022d6a959" returned: 0 in 0.775s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-95e3c66a-b926-4cf0-8475-960022d6a959 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:21 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-95e3c66a-b926-4cf0-8475-960022d6a959 Sep 25 10:53:21 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:21 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.569s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:21 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:21 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Deleted volume successfully. Sep 25 10:53:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-93c11d6b-9b68-4aeb-a512-49dafc922635 tempest-VolumesTransfersV355Test-1979391148 None] Lock "cinder-f7e03267-af04-4bb9-b257-5dd9cd3a880e-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:21 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-95e3c66a-b926-4cf0-8475-960022d6a959" returned: 0 in 0.564s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "cinder-quobyte-95e3c66a-b926-4cf0-8475-960022d6a959" released by "delete_volume" :: held 1.429s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:21 devstack cinder-volume[86874]: WARNING cinder.quota [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1545873312-75988265 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1545873312-75988265, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:53:21 devstack cinder-volume[86874]: WARNING cinder.quota [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1545873312-75988265 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1545873312-75988265, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:53:21 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Created reservations ['a63f00b4-849b-4fdd-82f0-3ff0224a41e3', 'b5aec4f0-b135-4d70-9f09-42063fd415a5', '216ed195-8f13-42d6-b278-1e073c7cd8b6', '40f451ae-1726-4e76-8448-d766ba2fed55'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:21 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:53:21 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:22 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.464s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Flow 'volume_create_manager' (a771913c-e94e-4389-a9ec-ef9ec967569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f856657-160b-4725-bd90-bd8a3662c47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:22 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Deleted volume successfully. Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f856657-160b-4725-bd90-bd8a3662c47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1226532875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90143d25-27f6-4c3f-a29f-bbdf85efa657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26549ecf3dd1402c8b7f1fbc123ee63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:22Z,use_quota=True,user_id='f6833124312b4ae5a79d2da2c892bc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb152a23-3c68-4fe2-926e-f535c3436572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb152a23-3c68-4fe2-926e-f535c3436572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc86930-3d3e-4084-8680-9fe1a1bf0096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc86930-3d3e-4084-8680-9fe1a1bf0096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90143d25-27f6-4c3f-a29f-bbdf85efa657', 'volume_name': 'volume-90143d25-27f6-4c3f-a29f-bbdf85efa657', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfc88fb-6c05-4910-8b28-c4c2ff221c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfc88fb-6c05-4910-8b28-c4c2ff221c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b937b9-bb87-4511-90fd-56aa81621593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:22 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Volume 90143d25-27f6-4c3f-a29f-bbdf85efa657: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90143d25-27f6-4c3f-a29f-bbdf85efa657', 'volume_size': 1} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1226532875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90143d25-27f6-4c3f-a29f-bbdf85efa657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26549ecf3dd1402c8b7f1fbc123ee63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:22Z,use_quota=True,user_id='f6833124312b4ae5a79d2da2c892bc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Creating volume 90143d25-27f6-4c3f-a29f-bbdf85efa657 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:22 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-90143d25-27f6-4c3f-a29f-bbdf85efa657 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0f1344e3-5996-44e8-acb8-b38f152293e1 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "cinder-95e3c66a-b926-4cf0-8475-960022d6a959-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:22 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-90143d25-27f6-4c3f-a29f-bbdf85efa657 1073741824 Sep 25 10:53:22 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:23 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-90143d25-27f6-4c3f-a29f-bbdf85efa657 1073741824" returned: 0 in 0.648s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-90143d25-27f6-4c3f-a29f-bbdf85efa657 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:23 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-90143d25-27f6-4c3f-a29f-bbdf85efa657 Sep 25 10:53:23 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:23 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-90143d25-27f6-4c3f-a29f-bbdf85efa657" returned: 0 in 0.311s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:53:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b937b9-bb87-4511-90fd-56aa81621593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90143d25-27f6-4c3f-a29f-bbdf85efa657', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea81ccd-2a1b-4b39-8e97-c06ddfa11f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:23 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Volume volume-90143d25-27f6-4c3f-a29f-bbdf85efa657 (90143d25-27f6-4c3f-a29f-bbdf85efa657): created successfully Sep 25 10:53:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea81ccd-2a1b-4b39-8e97-c06ddfa11f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Flow 'volume_create_manager' (a771913c-e94e-4389-a9ec-ef9ec967569e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-06efb32b-3787-49f7-8a1d-6682aa3c9c61 tempest-VolumesTransfersV355Test-1950699673 None] Created volume successfully. Sep 25 10:53:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Acquiring lock "cinder-90143d25-27f6-4c3f-a29f-bbdf85efa657-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Lock "cinder-90143d25-27f6-4c3f-a29f-bbdf85efa657-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Acquiring lock "cinder-quobyte-90143d25-27f6-4c3f-a29f-bbdf85efa657" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Lock "cinder-quobyte-90143d25-27f6-4c3f-a29f-bbdf85efa657" acquired by "delete_volume" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:25 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[767bf84f-b968-435b-b634-f7c98baeadfc]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-90143d25-27f6-4c3f-a29f-bbdf85efa657 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:25 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-90143d25-27f6-4c3f-a29f-bbdf85efa657 Sep 25 10:53:25 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:25 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-90143d25-27f6-4c3f-a29f-bbdf85efa657" returned: 0 in 0.579s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-90143d25-27f6-4c3f-a29f-bbdf85efa657 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:25 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-90143d25-27f6-4c3f-a29f-bbdf85efa657 Sep 25 10:53:25 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:26 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:53:26 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:26 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-90143d25-27f6-4c3f-a29f-bbdf85efa657" returned: 0 in 0.484s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Lock "cinder-quobyte-90143d25-27f6-4c3f-a29f-bbdf85efa657" released by "delete_volume" :: held 1.139s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Created reservations ['48d04e88-3cea-4666-aea2-3398f54e37fe', 'dce2b880-02fe-4420-b02c-df03d6217e94', '90802417-f44e-4303-9420-2f28f4744b06', 'e33f40cb-db79-4a36-b4b3-1718efcd79e8'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:26 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:53:26 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:26 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.487s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:53:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:53:27 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.615s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:27 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:27 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Deleted volume successfully. Sep 25 10:53:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3436e744-055a-436d-8c95-63f34145cfa8 tempest-VolumesTransfersV355Test-1979391148 None] Lock "cinder-90143d25-27f6-4c3f-a29f-bbdf85efa657-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:30 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-e591c1b2-1f4c-4fd4-8b2c-fa396bc8a7f0 req-35737562-9061-40a4-938d-f1324794d347 tempest-TestInstancesWithCinderVolumes-344012517 None] Terminate volume connection completed successfully. Sep 25 10:53:30 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e591c1b2-1f4c-4fd4-8b2c-fa396bc8a7f0 req-35737562-9061-40a4-938d-f1324794d347 tempest-TestInstancesWithCinderVolumes-344012517 None] Deleting attachment 5d4f8897-3021-44d2-8ee5-bd84b357815d. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:53:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "cinder-b0961b34-4fb4-447a-8d5f-23d511bd8808-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "cinder-b0961b34-4fb4-447a-8d5f-23d511bd8808-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:32 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=83,cinder:UPDATE=105,cinder:INSERT=19,cinder:DELETE=10 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:53:32 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=94,cinder:UPDATE=92,cinder:INSERT=27,cinder:DELETE=6 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:53:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "cinder-quobyte-b0961b34-4fb4-447a-8d5f-23d511bd8808" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "cinder-quobyte-b0961b34-4fb4-447a-8d5f-23d511bd8808" acquired by "delete_volume" :: waited 0.038s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:32 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a516cc-9120-4442-bc21-a86632679cf2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-617564f0-b66c-4c5d-9c3a-0f7d248cd909 tempest-VolumesActionsTest-2104349504 None] Acquiring lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" by "attach_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-617564f0-b66c-4c5d-9c3a-0f7d248cd909 tempest-VolumesActionsTest-2104349504 None] Lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" acquired by "attach_volume" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:32 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 Sep 25 10:53:32 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:32 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-617564f0-b66c-4c5d-9c3a-0f7d248cd909 tempest-VolumesActionsTest-2104349504 None] Attaching volume ee8d9e86-3c20-442a-863b-f9e87ab5bc97 to instance 5cd88aef-a7ea-45bc-b462-3cfc05cd0d6f at mountpoint /dev/vdb on host None. Sep 25 10:53:32 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-617564f0-b66c-4c5d-9c3a-0f7d248cd909 tempest-VolumesActionsTest-2104349504 None] Attach volume completed successfully. Sep 25 10:53:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-617564f0-b66c-4c5d-9c3a-0f7d248cd909 tempest-VolumesActionsTest-2104349504 None] Lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" released by "attach_volume" :: held 0.182s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:32 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808" returned: 0 in 0.658s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:32 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808 Sep 25 10:53:32 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9ad3284a-c7fc-4fed-b97e-f3927fff0066 tempest-VolumesActionsTest-2104349504 None] Acquiring lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97-detach_volume" by "detach_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9ad3284a-c7fc-4fed-b97e-f3927fff0066 tempest-VolumesActionsTest-2104349504 None] Lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:33 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-9ad3284a-c7fc-4fed-b97e-f3927fff0066 tempest-VolumesActionsTest-2104349504 None] Detaching volume ee8d9e86-3c20-442a-863b-f9e87ab5bc97 from instance 5cd88aef-a7ea-45bc-b462-3cfc05cd0d6f. Sep 25 10:53:33 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0961b34-4fb4-447a-8d5f-23d511bd8808" returned: 0 in 0.516s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "cinder-quobyte-b0961b34-4fb4-447a-8d5f-23d511bd8808" released by "delete_volume" :: held 1.252s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:33 devstack cinder-volume[86874]: WARNING cinder.quota [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-613493553-1521268745 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-613493553-1521268745, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:53:33 devstack cinder-volume[86874]: WARNING cinder.quota [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-613493553-1521268745 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-613493553-1521268745, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:53:33 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-9ad3284a-c7fc-4fed-b97e-f3927fff0066 tempest-VolumesActionsTest-2104349504 None] Detach volume completed successfully. Sep 25 10:53:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9ad3284a-c7fc-4fed-b97e-f3927fff0066 tempest-VolumesActionsTest-2104349504 None] Lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:33 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Created reservations ['a9170e2c-315c-4346-9059-f0dc85930b26', '98f3ffa6-4bd0-4bd9-8a1f-e3a99bcb7e1c', 'd2224a5e-35eb-48ee-9f03-646cf6925beb', 'bdceb263-5f01-41fb-a5d1-a8ed9ad17eec'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:33 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:53:33 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:34 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.512s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:34 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:34 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Deleted volume successfully. Sep 25 10:53:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a2d65181-dd5b-4d24-900f-0334a34b86a2 tempest-TestInstancesWithCinderVolumes-344012517 None] Lock "cinder-b0961b34-4fb4-447a-8d5f-23d511bd8808-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Flow 'volume_create_manager' (2f6251dc-ede4-46dc-9559-e103c8fde3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1114056d-25c3-48ab-baa3-87bf8ccf69a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1114056d-25c3-48ab-baa3-87bf8ccf69a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-968645016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d198da-5d58-4dc9-881c-01710dd005e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64910b83ab045d3a96f8ab8e67726ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:39Z,use_quota=True,user_id='0e9d2d940b064a1087d4b84ef740c59d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cd2e4c-8fca-4c1c-8231-aec58a0a278e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cd2e4c-8fca-4c1c-8231-aec58a0a278e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9152d48-5bee-43d3-81b1-957e60942a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9152d48-5bee-43d3-81b1-957e60942a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d198da-5d58-4dc9-881c-01710dd005e3', 'volume_name': 'volume-81d198da-5d58-4dc9-881c-01710dd005e3', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df48be6d-2d52-4317-9f99-e41e71d368cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df48be6d-2d52-4317-9f99-e41e71d368cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7503bef8-9667-44a1-838e-4844f0c0564d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:39 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Volume 81d198da-5d58-4dc9-881c-01710dd005e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d198da-5d58-4dc9-881c-01710dd005e3', 'volume_size': 1} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-968645016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d198da-5d58-4dc9-881c-01710dd005e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64910b83ab045d3a96f8ab8e67726ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:39Z,use_quota=True,user_id='0e9d2d940b064a1087d4b84ef740c59d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Creating volume 81d198da-5d58-4dc9-881c-01710dd005e3 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:39 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:39 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 1073741824 Sep 25 10:53:39 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:39 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 1073741824" returned: 0 in 0.681s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:40 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 Sep 25 10:53:40 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:40 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3" returned: 0 in 0.273s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.288s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7503bef8-9667-44a1-838e-4844f0c0564d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d198da-5d58-4dc9-881c-01710dd005e3', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0efc37-95a2-4519-a293-4d190af15bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[866aa22c-60da-405c-8c49-126d688826b2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:40 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Volume volume-81d198da-5d58-4dc9-881c-01710dd005e3 (81d198da-5d58-4dc9-881c-01710dd005e3): created successfully Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0efc37-95a2-4519-a293-4d190af15bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Flow 'volume_create_manager' (2f6251dc-ede4-46dc-9559-e103c8fde3b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:40 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-87ad20f2-807e-4e1e-af30-1a2d8ac90958 tempest-VolumesCloneTest-535540939 None] Created volume successfully. Sep 25 10:53:40 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 Sep 25 10:53:40 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:40 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" returned: 0 in 0.407s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2939ba40-3211-4387-8174-e2d5a3e9d5fd]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:40 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 Sep 25 10:53:40 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:41 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" returned: 0 in 0.479s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.f9d3578d-3a3f-48fe-82e9-e22953948655pfz7b6xq.img {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:41 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.f9d3578d-3a3f-48fe-82e9-e22953948655pfz7b6xq.img Sep 25 10:53:41 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:42 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Flow 'volume_create_manager' (b41da485-810e-40b2-9c68-8ad01b0edfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6bccd3-4b67-424f-bedc-18618b48e2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6bccd3-4b67-424f-bedc-18618b48e2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1763643767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937ccaa6-9a06-4b46-ab99-ab5942de3472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64910b83ab045d3a96f8ab8e67726ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=81d198da-5d58-4dc9-881c-01710dd005e3,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:42Z,use_quota=True,user_id='0e9d2d940b064a1087d4b84ef740c59d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf904625-6b04-44b1-8a8d-380e41c123ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf904625-6b04-44b1-8a8d-380e41c123ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5899a2-79b2-43d0-95f9-3ef45b5b1567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5899a2-79b2-43d0-95f9-3ef45b5b1567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '937ccaa6-9a06-4b46-ab99-ab5942de3472', 'volume_name': 'volume-937ccaa6-9a06-4b46-ab99-ab5942de3472', 'volume_size': 2, 'source_volid': '81d198da-5d58-4dc9-881c-01710dd005e3', 'source_volstatus': 'available'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f73b5f-b9a9-4551-8c04-4121e990c046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f73b5f-b9a9-4551-8c04-4121e990c046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:42 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b4b2d3-fd32-4d74-b04f-3c921fcfa7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:42 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Volume 937ccaa6-9a06-4b46-ab99-ab5942de3472: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-937ccaa6-9a06-4b46-ab99-ab5942de3472', 'volume_size': 2, 'source_volid': '81d198da-5d58-4dc9-881c-01710dd005e3', 'source_volstatus': 'available'} Sep 25 10:53:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:48 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.f9d3578d-3a3f-48fe-82e9-e22953948655pfz7b6xq.img" returned: 0 in 7.256s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:48 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82718d5-c33a-47f7-ad70-db60137f3b30]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:48 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 Sep 25 10:53:48 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:49 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" returned: 0 in 0.611s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:49 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97, size 1024.00 MB, duration 7.26 sec, destination /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.f9d3578d-3a3f-48fe-82e9-e22953948655pfz7b6xq.img {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:53:49 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] Converted 1024.00 MB image at 141.11 MB/s Sep 25 10:53:49 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] f9d3578d-3a3f-48fe-82e9-e22953948655 was raw, no need to convert to raw {{(pid=86874) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 10:53:59 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=14,cinder:UPDATE=18,cinder:INSERT=2 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:53:59 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=20,cinder:INSERT=5,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:54:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.762s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] Uploaded volume to glance image-id: f9d3578d-3a3f-48fe-82e9-e22953948655. {{(pid=86874) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 10:54:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 30.410s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:13 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Cloning volume 81d198da-5d58-4dc9-881c-01710dd005e3 to volume 937ccaa6-9a06-4b46-ab99-ab5942de3472 Sep 25 10:54:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bfb0e69a-744c-4bfa-b4cb-0783c1f7e6a4 tempest-VolumesActionsTest-2104349504 None] Copy volume to image completed successfully. Sep 25 10:54:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Creating offline snapshot d93ba0e8-f94a-4731-87ae-1328784cc43f of volume 81d198da-5d58-4dc9-881c-01710dd005e3 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:54:13 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa6a3de-854c-451a-b475-5083f9681f32]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:13 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 Sep 25 10:54:13 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:13 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3" returned: 0 in 0.513s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:13 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f 1G Sep 25 10:54:13 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:14 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f 1G" returned: 0 in 0.613s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81d198da-5d58-4dc9-881c-01710dd005e3 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:14 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81d198da-5d58-4dc9-881c-01710dd005e3 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f Sep 25 10:54:14 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:14 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81d198da-5d58-4dc9-881c-01710dd005e3 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f" returned: 0 in 0.362s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:14 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f is being set with open permissions: ugo+rw Sep 25 10:54:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:14 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f Sep 25 10:54:14 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:15 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f" returned: 0 in 0.289s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:15 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.info Sep 25 10:54:15 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:15 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.info" returned: 0 in 0.306s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:15 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.info is being set with open permissions: ugo+rw Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:15 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.info Sep 25 10:54:15 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:15 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.info" returned: 0 in 0.276s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Acquiring lock "cinder-quobyte-937ccaa6-9a06-4b46-ab99-ab5942de3472" by "_copy_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Lock "cinder-quobyte-937ccaa6-9a06-4b46-ab99-ab5942de3472" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] snapshot: d93ba0e8-f94a-4731-87ae-1328784cc43f, volume: 937ccaa6-9a06-4b46-ab99-ab5942de3472, {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab162ed-f8f2-49dc-8c5e-cb7770a99fba]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:15 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f Sep 25 10:54:15 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:16 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f" returned: 0 in 0.448s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81d198da-5d58-4dc9-881c-01710dd005e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:54:16 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5528c8d9-6966-44ce-bb8d-eea0e17b383d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:16 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 Sep 25 10:54:16 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:16 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3" returned: 0 in 0.439s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] will copy from snapshot at /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:54:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Creating direct copy from snapshot {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:54:16 devstack cinder-volume[86874]: DEBUG cinder.utils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Path /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472 not found in is_blk_device check {{(pid=86874) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 10:54:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:16 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472 Sep 25 10:54:16 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:24 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472" returned: 0 in 7.848s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:24 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3, size 1024.00 MB, duration 7.85 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:54:24 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Converted 1024.00 MB image at 130.45 MB/s Sep 25 10:54:24 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472 is being set with open permissions: ugo+rw Sep 25 10:54:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:24 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472 Sep 25 10:54:24 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:24 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472" returned: 0 in 0.353s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Lock "cinder-quobyte-937ccaa6-9a06-4b46-ab99-ab5942de3472" released by "_copy_volume_from_snapshot" :: held 9.183s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Acquiring lock "cinder-quobyte-d93ba0e8-f94a-4731-87ae-1328784cc43f" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Lock "cinder-quobyte-d93ba0e8-f94a-4731-87ae-1328784cc43f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Deleting offline snapshot d93ba0e8-f94a-4731-87ae-1328784cc43f of volume 81d198da-5d58-4dc9-881c-01710dd005e3 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] snapshot_file for this snap is: volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1eb5513-5203-40b8-92e6-2f7f63a3660a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1,cinder:INSERT=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:25 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f Sep 25 10:54:25 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Flow 'volume_create_manager' (95c41252-1cb1-4845-ad75-671b9fa910c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cebaf3-6335-4c3e-94fe-446b73989b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cebaf3-6335-4c3e-94fe-446b73989b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-456562648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31bac80c-5bec-4ba6-893e-2f567826cb31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d6b4ca41224b469ba08b93105ed265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:25Z,use_quota=True,user_id='2029f83698b3462cab43aa3b659e9e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87d6ad3-98b4-4561-b759-08a659be17ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87d6ad3-98b4-4561-b759-08a659be17ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77880245-0552-444b-a9cb-c468d5763a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77880245-0552-444b-a9cb-c468d5763a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31bac80c-5bec-4ba6-893e-2f567826cb31', 'volume_name': 'volume-31bac80c-5bec-4ba6-893e-2f567826cb31', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00375f9-c5ef-4a27-ba9a-6d0416691960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00375f9-c5ef-4a27-ba9a-6d0416691960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39dd1d9-269b-4730-bf13-f512ce0943bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:25 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Volume 31bac80c-5bec-4ba6-893e-2f567826cb31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31bac80c-5bec-4ba6-893e-2f567826cb31', 'volume_size': 1} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:25 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f" returned: 0 in 0.493s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81d198da-5d58-4dc9-881c-01710dd005e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[56478ca5-e9f7-4b2f-8583-73b8fefa7d86]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:25 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 Sep 25 10:54:25 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:26 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:54:26 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:26 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3" returned: 0 in 0.621s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:26 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f Sep 25 10:54:26 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:26 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.333s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:54:26 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f" returned: 0 in 0.416s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:26 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f Sep 25 10:54:26 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:26 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3.d93ba0e8-f94a-4731-87ae-1328784cc43f" returned: 0 in 0.335s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Lock "cinder-quobyte-d93ba0e8-f94a-4731-87ae-1328784cc43f" released by "_delete_snapshot" :: held 1.994s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.924s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 12.056s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b4b2d3-fd32-4d74-b04f-3c921fcfa7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937ccaa6-9a06-4b46-ab99-ab5942de3472', 'volume_size': 2, 'source_volid': '81d198da-5d58-4dc9-881c-01710dd005e3', 'source_volstatus': 'available'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17bec87-bc45-43d3-a7cf-cc0d9eaca705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:27 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[55115bae-cdc8-46be-8945-57b0d72216ed]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:27 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Volume volume-937ccaa6-9a06-4b46-ab99-ab5942de3472 (937ccaa6-9a06-4b46-ab99-ab5942de3472): created successfully Sep 25 10:54:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17bec87-bc45-43d3-a7cf-cc0d9eaca705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Flow 'volume_create_manager' (b41da485-810e-40b2-9c68-8ad01b0edfc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:27 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b755070c-11f9-42d7-b7ef-1f1c0037d1d7 tempest-VolumesCloneTest-535540939 None] Created volume successfully. Sep 25 10:54:27 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 Sep 25 10:54:27 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:27 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" returned: 0 in 0.398s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:27 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4deee0-f06e-49cc-b15e-89269e9244e3]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:27 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 Sep 25 10:54:27 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:27 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" returned: 0 in 0.469s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:27 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img Sep 25 10:54:27 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Acquiring lock "cinder-937ccaa6-9a06-4b46-ab99-ab5942de3472-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Lock "cinder-937ccaa6-9a06-4b46-ab99-ab5942de3472-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Acquiring lock "cinder-quobyte-937ccaa6-9a06-4b46-ab99-ab5942de3472" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Lock "cinder-quobyte-937ccaa6-9a06-4b46-ab99-ab5942de3472" acquired by "delete_volume" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:28 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e66c81-9be4-4d2e-909f-64ad3e59ab82]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:28 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472 Sep 25 10:54:28 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:29 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472" returned: 0 in 0.704s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:29 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472 Sep 25 10:54:29 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:29 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-937ccaa6-9a06-4b46-ab99-ab5942de3472" returned: 0 in 0.426s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Lock "cinder-quobyte-937ccaa6-9a06-4b46-ab99-ab5942de3472" released by "delete_volume" :: held 1.222s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:29 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Created reservations ['00f14009-9527-492f-bdd3-81ceda1bdec3', '7ad87148-97ad-4201-9e9b-3e7661136120', 'b3f3ec33-ce32-462b-a200-d1909c5d8f40', 'fcfb5f3b-6629-440d-95ec-26cf82aa2fa7'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:29 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:54:29 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:30 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.384s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:30 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:30 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Deleted volume successfully. Sep 25 10:54:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-042de0f3-6681-4246-ae4b-0dfd01c480ec tempest-VolumesCloneTest-535540939 None] Lock "cinder-937ccaa6-9a06-4b46-ab99-ab5942de3472-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Acquiring lock "cinder-81d198da-5d58-4dc9-881c-01710dd005e3-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Lock "cinder-81d198da-5d58-4dc9-881c-01710dd005e3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Acquiring lock "cinder-quobyte-81d198da-5d58-4dc9-881c-01710dd005e3" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Lock "cinder-quobyte-81d198da-5d58-4dc9-881c-01710dd005e3" acquired by "delete_volume" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:31 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0620489b-82b7-4dfa-8b13-7a0309335f0c]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:31 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 Sep 25 10:54:31 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:31 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3" returned: 0 in 0.683s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:31 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3 Sep 25 10:54:31 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:32 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-81d198da-5d58-4dc9-881c-01710dd005e3" returned: 0 in 0.446s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Lock "cinder-quobyte-81d198da-5d58-4dc9-881c-01710dd005e3" released by "delete_volume" :: held 1.272s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:32 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Created reservations ['95282f64-defb-486a-a976-ce9b4e679fa3', '25dfb5d2-25bf-4984-92b3-347f4e50e061', '6e7dad91-6077-4808-927a-693d60359e87', 'a9cb7739-b49a-4d77-a7c6-812da8375bbe'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:32 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:54:32 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:32 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.390s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:32 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:32 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Deleted volume successfully. Sep 25 10:54:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-79a0e2a8-5aaf-479a-8b22-ad7c6d0737f5 tempest-VolumesCloneTest-535540939 None] Lock "cinder-81d198da-5d58-4dc9-881c-01710dd005e3-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:34 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img" returned: 0 in 6.884s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:34 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7823e42-3ad8-464a-8d06-c8881166cb9d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:34 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 Sep 25 10:54:34 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:35 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" returned: 0 in 0.650s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:35 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:54:35 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Converted 1024.00 MB image at 148.73 MB/s Sep 25 10:54:35 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] 825e8220-9d64-4981-89fc-aba98dab2779 was raw, converting to qcow2 {{(pid=86874) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 25 10:54:35 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a0c61c-86a9-4d64-868d-93287c8ee56d]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:35 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img Sep 25 10:54:35 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:35 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img" returned: 0 in 0.422s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:36 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img Sep 25 10:54:36 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:36 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img" returned: 1 in 0.363s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:54:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img /opt/stack/data/cinder/conversion/vol_upload_jc0x_79v {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:36 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img /opt/stack/data/cinder/conversion/vol_upload_jc0x_79v Sep 25 10:54:36 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:36 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img /opt/stack/data/cinder/conversion/vol_upload_jc0x_79v" returned: 0 in 0.292s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:36 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Image conversion details: src /opt/stack/data/cinder/conversion/ee8d9e86-3c20-442a-863b-f9e87ab5bc97.temp_image.825e8220-9d64-4981-89fc-aba98dab2779u3szqi0a.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_jc0x_79v {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:54:36 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 25 10:54:36 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0112e22f-f676-40e8-aaf2-8eb29d640b3a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jc0x_79v {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:36 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jc0x_79v Sep 25 10:54:36 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:37 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jc0x_79v" returned: 0 in 0.422s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Flow 'volume_create_manager' (d59a7655-bcdf-4d37-bc09-828bb2e20b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e08dd7c-e730-4ac5-a24c-42e3e1c3de65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e08dd7c-e730-4ac5-a24c-42e3e1c3de65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1129767651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d90760e-95cb-4a0f-b6b0-3d61e478f001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3365399033d94a149567803f5488b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:38Z,use_quota=True,user_id='ca174def1b1a4e1f8518466ae0a74466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f66280-5a68-4348-bb41-f5db2342882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f66280-5a68-4348-bb41-f5db2342882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e90872-6e65-4a74-8dde-17a077741f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e90872-6e65-4a74-8dde-17a077741f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d90760e-95cb-4a0f-b6b0-3d61e478f001', 'volume_name': 'volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001', 'volume_size': 2}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48927f75-5788-41c9-9f83-0f625e12f3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48927f75-5788-41c9-9f83-0f625e12f3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26a4fb0-107e-4be3-ac74-31a99ca5c463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:38 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Volume 6d90760e-95cb-4a0f-b6b0-3d61e478f001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001', 'volume_size': 2} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.769s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Uploaded volume to glance image-id: 825e8220-9d64-4981-89fc-aba98dab2779. {{(pid=86874) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.520s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-456562648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31bac80c-5bec-4ba6-893e-2f567826cb31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d6b4ca41224b469ba08b93105ed265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:25Z,use_quota=True,user_id='2029f83698b3462cab43aa3b659e9e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Creating volume 31bac80c-5bec-4ba6-893e-2f567826cb31 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:38 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:54:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:38 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 1073741824 Sep 25 10:54:38 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:38 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-37ab472e-7827-4889-86a1-c7881f513e33 tempest-VolumesActionsTest-2104349504 None] Copy volume to image completed successfully. Sep 25 10:54:39 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 1073741824" returned: 0 in 0.485s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:39 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 Sep 25 10:54:39 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:39 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31" returned: 0 in 0.388s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1129767651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d90760e-95cb-4a0f-b6b0-3d61e478f001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3365399033d94a149567803f5488b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:38Z,use_quota=True,user_id='ca174def1b1a4e1f8518466ae0a74466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Creating volume 6d90760e-95cb-4a0f-b6b0-3d61e478f001 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:39 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001 2147483648 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:39 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001 2147483648 Sep 25 10:54:39 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39dd1d9-269b-4730-bf13-f512ce0943bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31bac80c-5bec-4ba6-893e-2f567826cb31', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8be5d34-8669-4df1-aa0c-ed3c0eaab9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:39 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Volume volume-31bac80c-5bec-4ba6-893e-2f567826cb31 (31bac80c-5bec-4ba6-893e-2f567826cb31): created successfully Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8be5d34-8669-4df1-aa0c-ed3c0eaab9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Flow 'volume_create_manager' (95c41252-1cb1-4845-ad75-671b9fa910c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:39 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7c93aeb3-abdb-4613-b77e-f4edc9dfd98b tempest-TestImageHashVerification-171604702 None] Created volume successfully. Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Acquiring lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:40 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Acquiring lock "cinder-quobyte-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001 2147483648" returned: 0 in 0.668s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Lock "cinder-quobyte-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" acquired by "delete_volume" :: waited 0.033s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[da049d03-0db0-4508-afa4-44ea4ee70d53]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:40 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 Sep 25 10:54:40 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:40 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001 Sep 25 10:54:40 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:40 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001" returned: 0 in 0.290s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:40 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26a4fb0-107e-4be3-ac74-31a99ca5c463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001', 'volume_size': 2}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0de4e7-30fe-409b-999c-d5717db4c25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" returned: 0 in 0.452s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:40 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Volume volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001 (6d90760e-95cb-4a0f-b6b0-3d61e478f001): created successfully Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0de4e7-30fe-409b-999c-d5717db4c25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:40 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97 Sep 25 10:54:40 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Flow 'volume_create_manager' (d59a7655-bcdf-4d37-bc09-828bb2e20b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:40 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-53585882-5623-4621-b3fb-dbb1f4436f62 tempest-VolumesCloneNegativeTest-1845775215 None] Created volume successfully. Sep 25 10:54:41 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" returned: 0 in 0.301s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Lock "cinder-quobyte-ee8d9e86-3c20-442a-863b-f9e87ab5bc97" released by "delete_volume" :: held 0.805s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Created reservations ['e7e1fac6-e49c-4e70-af01-36f661da8dd0', '8766e6a6-a186-4303-be6c-b88b31b7362b', '3f015900-ecbb-4424-9dc3-87fa4bc0597b', 'e92d42d2-f23a-4db7-b9d2-83ce48928b52'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:41 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:54:41 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:41 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.310s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:41 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Deleted volume successfully. Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fa8ad549-5437-432c-8a13-05f935346dc6 tempest-VolumesActionsTest-2104349504 None] Lock "cinder-ee8d9e86-3c20-442a-863b-f9e87ab5bc97-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc693d5-d259-43ce-b254-96aacffbbba5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Acquiring lock "cinder-6d90760e-95cb-4a0f-b6b0-3d61e478f001-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Lock "cinder-6d90760e-95cb-4a0f-b6b0-3d61e478f001-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:42 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 Sep 25 10:54:42 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Acquiring lock "cinder-quobyte-6d90760e-95cb-4a0f-b6b0-3d61e478f001" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Lock "cinder-quobyte-6d90760e-95cb-4a0f-b6b0-3d61e478f001" acquired by "delete_volume" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:42 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89bd2fb-806a-46ce-aa05-09e260ec8469]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:42 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001 Sep 25 10:54:42 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:42 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31" returned: 0 in 0.508s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:42 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbb8e39-c5ee-4a1a-b997-5565b8538ba6]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:42 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 Sep 25 10:54:42 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:42 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001" returned: 0 in 0.481s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:42 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001 Sep 25 10:54:42 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:42 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6d90760e-95cb-4a0f-b6b0-3d61e478f001" returned: 0 in 0.337s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:42 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31" returned: 0 in 0.557s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 /opt/stack/data/cinder/conversion/31bac80c-5bec-4ba6-893e-2f567826cb31.temp_image.34443ff8-35a9-46bd-94e2-8cd82fd301514ylnc9rg.img {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Lock "cinder-quobyte-6d90760e-95cb-4a0f-b6b0-3d61e478f001" released by "delete_volume" :: held 0.896s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:42 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 /opt/stack/data/cinder/conversion/31bac80c-5bec-4ba6-893e-2f567826cb31.temp_image.34443ff8-35a9-46bd-94e2-8cd82fd301514ylnc9rg.img Sep 25 10:54:42 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:43 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Created reservations ['13461cf6-b7a0-4e18-ad53-1821bfc59add', '1ee068fd-a520-4e39-8da8-750abb180b16', '74506e7f-6751-4bca-a5ab-4a4f4c095717', 'c93cc78b-1af2-4fbd-80c9-4fc8fe909bd1'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:43 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:54:43 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:43 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.393s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:43 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:43 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Deleted volume successfully. Sep 25 10:54:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8fe66027-538b-443f-8204-886fb58030f5 tempest-VolumesCloneNegativeTest-1845775215 None] Lock "cinder-6d90760e-95cb-4a0f-b6b0-3d61e478f001-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:51 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 /opt/stack/data/cinder/conversion/31bac80c-5bec-4ba6-893e-2f567826cb31.temp_image.34443ff8-35a9-46bd-94e2-8cd82fd301514ylnc9rg.img" returned: 0 in 8.611s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d6e953-5870-4d44-989c-9e25ad24fda5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Flow 'volume_create_manager' (94ab86b4-5e01-47da-8195-a508c76e2617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84678810-41f5-42c7-9ebc-e3f97a8b8310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:51 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 Sep 25 10:54:51 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84678810-41f5-42c7-9ebc-e3f97a8b8310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1913422198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c4c8899-5279-46ab-a654-489eb66fd935,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='21bb994d66804db29575355949b9d7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:52Z,use_quota=True,user_id='d81bd7d5deaf4b3fbe619218d2f68dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e877342-ef4c-487c-8ae5-57092425e6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e877342-ef4c-487c-8ae5-57092425e6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fc9d73-0099-4dd4-b157-ba872f36344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fc9d73-0099-4dd4-b157-ba872f36344d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c4c8899-5279-46ab-a654-489eb66fd935', 'volume_name': 'volume-4c4c8899-5279-46ab-a654-489eb66fd935', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6903204c-9aee-4b49-a958-429a8d31bd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6903204c-9aee-4b49-a958-429a8d31bd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630337b9-665d-458f-8079-dcf12a4d5702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:51 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Volume 4c4c8899-5279-46ab-a654-489eb66fd935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c4c8899-5279-46ab-a654-489eb66fd935', 'volume_size': 1} Sep 25 10:54:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:52 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31" returned: 0 in 0.565s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:52 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31, size 1024.00 MB, duration 8.61 sec, destination /opt/stack/data/cinder/conversion/31bac80c-5bec-4ba6-893e-2f567826cb31.temp_image.34443ff8-35a9-46bd-94e2-8cd82fd301514ylnc9rg.img {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:54:52 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] Converted 1024.00 MB image at 118.90 MB/s Sep 25 10:54:52 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] 34443ff8-35a9-46bd-94e2-8cd82fd30151 was raw, no need to convert to raw {{(pid=86874) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 10:54:55 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Flow 'volume_create_manager' (229bd518-d40a-4966-8f78-988d2b324b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80e745f-c2e6-4e27-880e-a98d707b2aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80e745f-c2e6-4e27-880e-a98d707b2aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-519490857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872b9e4a-42ab-46bd-83b2-1bd15d8b70f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a4f09f055d949a29d106a704438bf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:55Z,use_quota=True,user_id='3c5e711338df4e4abaa517fe6ee88e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78a2e30-5473-43fc-b900-f4b9e94963a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78a2e30-5473-43fc-b900-f4b9e94963a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff820ef-6660-4bc7-b768-64e4a2a2247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:55 devstack cinder-volume[86874]: DEBUG cinder.image.glance [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Creating Keystone auth plugin from conf {{(pid=86874) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:54:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff820ef-6660-4bc7-b768-64e4a2a2247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '872b9e4a-42ab-46bd-83b2-1bd15d8b70f2', 'volume_name': 'volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c698e0a-98c1-47f0-80e8-d5526245e2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c698e0a-98c1-47f0-80e8-d5526245e2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073efb4a-5697-4a39-ad02-fb0616c0f365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:55 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Volume 872b9e4a-42ab-46bd-83b2-1bd15d8b70f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 10:54:55 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Trying to clone 872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 from image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]). {{(pid=86874) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:54:56 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_df40s2cydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:54:56 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Image download 20.69 MB at 20.69 MB/s Sep 25 10:54:56 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5e3045-ac7c-4340-a6f7-b9fa8937a933]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_df40s2cydevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:56 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_df40s2cydevstack@QuobyteHD Sep 25 10:54:56 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:56 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_df40s2cydevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:56 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Temporary image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 is fetched for user 3c5e711338df4e4abaa517fe6ee88e63. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:54:56 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[da63d42d-6e14-4803-abd1-d997bd0156c4]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_df40s2cydevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:56 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_df40s2cydevstack@QuobyteHD Sep 25 10:54:56 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:57 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_df40s2cydevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:06 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:INSERT=10,cinder:SELECT=34,cinder:UPDATE=45,cinder:DELETE=2 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:55:06 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=29,cinder:UPDATE=42,cinder:DELETE=5,cinder:INSERT=11 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:55:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.660s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] Uploaded volume to glance image-id: 34443ff8-35a9-46bd-94e2-8cd82fd30151. {{(pid=86874) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 10:55:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.726s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1913422198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c4c8899-5279-46ab-a654-489eb66fd935,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='21bb994d66804db29575355949b9d7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:52Z,use_quota=True,user_id='d81bd7d5deaf4b3fbe619218d2f68dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:55:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Creating volume 4c4c8899-5279-46ab-a654-489eb66fd935 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:12 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:55:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4c4c8899-5279-46ab-a654-489eb66fd935 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:12 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4c4c8899-5279-46ab-a654-489eb66fd935 1073741824 Sep 25 10:55:12 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:12 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-38a4eeee-e953-465e-9cb6-408bfd11970a tempest-TestImageHashVerification-171604702 None] Copy volume to image completed successfully. Sep 25 10:55:13 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4c4c8899-5279-46ab-a654-489eb66fd935 1073741824" returned: 0 in 0.509s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4c4c8899-5279-46ab-a654-489eb66fd935 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:13 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4c4c8899-5279-46ab-a654-489eb66fd935 Sep 25 10:55:13 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:13 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4c4c8899-5279-46ab-a654-489eb66fd935" returned: 0 in 0.292s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.201s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-519490857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872b9e4a-42ab-46bd-83b2-1bd15d8b70f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a4f09f055d949a29d106a704438bf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:55Z,use_quota=True,user_id='3c5e711338df4e4abaa517fe6ee88e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Creating volume 872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:13 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630337b9-665d-458f-8079-dcf12a4d5702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c4c8899-5279-46ab-a654-489eb66fd935', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a874b7-8d38-478a-9db2-625e87f7179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:13 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 1073741824 Sep 25 10:55:13 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:13 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Volume volume-4c4c8899-5279-46ab-a654-489eb66fd935 (4c4c8899-5279-46ab-a654-489eb66fd935): created successfully Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a874b7-8d38-478a-9db2-625e87f7179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Flow 'volume_create_manager' (94ab86b4-5e01-47da-8195-a508c76e2617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4ab65019-5c69-4b9f-8d56-9fa8b844a912 tempest-VolumesGetTest-1419671931 None] Created volume successfully. Sep 25 10:55:13 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Acquiring lock "cinder-31bac80c-5bec-4ba6-893e-2f567826cb31-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 1073741824" returned: 0 in 0.534s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Lock "cinder-31bac80c-5bec-4ba6-893e-2f567826cb31-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Acquiring lock "cinder-quobyte-31bac80c-5bec-4ba6-893e-2f567826cb31" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:13 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 Sep 25 10:55:13 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Lock "cinder-quobyte-31bac80c-5bec-4ba6-893e-2f567826cb31" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[542db701-2e37-4995-9b7e-ae9cb6a62ac5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:14 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 Sep 25 10:55:14 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:14 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2" returned: 0 in 0.285s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Attempting download of 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}])) to volume 872b9e4a-42ab-46bd-83b2-1bd15d8b70f2. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9fdfae-a8e1-4ce9-b5c6-2f2ca7b9d344]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_extvgcly {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:14 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31" returned: 0 in 0.424s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:14 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_extvgcly Sep 25 10:55:14 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31 Sep 25 10:55:14 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:14 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:14 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_extvgcly" returned: 0 in 0.384s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_extvgcly {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:14 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31bac80c-5bec-4ba6-893e-2f567826cb31" returned: 0 in 0.308s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Lock "cinder-quobyte-31bac80c-5bec-4ba6-893e-2f567826cb31" released by "delete_volume" :: held 0.782s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Created reservations ['7ac49a62-6f42-4b10-9967-40230dd1ed36', '9a922258-3ea2-484d-aeca-9f3ba07a9249', 'b44a0fc9-4df5-441c-9f21-9b98ed0b2562', '5bbbb5db-3abe-408a-9c1c-5b9287319ab6'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:14 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_extvgcly Sep 25 10:55:14 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:14 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:55:14 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:15 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_extvgcly" returned: 1 in 0.401s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_extvgcly' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[092b6920-00c6-4871-97ab-fa166f6cf13c]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_df40s2cydevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:15 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.361s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:15 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Deleted volume successfully. Sep 25 10:55:15 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_df40s2cydevstack@QuobyteHD Sep 25 10:55:15 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-558e7036-e994-4aa4-bec8-c4de1974caa3 tempest-TestImageHashVerification-171604702 None] Lock "cinder-31bac80c-5bec-4ba6-893e-2f567826cb31-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Flow 'volume_create_manager' (c45170a6-ceb5-4652-8c54-6c2a058aab55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a3cd78-7e3a-4aa2-8f08-806420e77802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:15 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a3cd78-7e3a-4aa2-8f08-806420e77802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-598757100',display_name='tempest-VolumesGetTest-Volume-1375894458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb56836d-fec5-4416-b6fc-62f60dcec74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bb994d66804db29575355949b9d7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:15Z,use_quota=True,user_id='d81bd7d5deaf4b3fbe619218d2f68dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fb7044-2d9c-424d-887d-f95757bfd780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fb7044-2d9c-424d-887d-f95757bfd780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8749115-7063-4ec3-bed3-1387a808bce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8749115-7063-4ec3-bed3-1387a808bce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb56836d-fec5-4416-b6fc-62f60dcec74e', 'volume_name': 'volume-bb56836d-fec5-4416-b6fc-62f60dcec74e', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4800ad76-f807-4389-92d0-0f1bb628c645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4800ad76-f807-4389-92d0-0f1bb628c645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3176bda-4639-4788-a46a-8a9d8f19a205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:15 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Volume bb56836d-fec5-4416-b6fc-62f60dcec74e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb56836d-fec5-4416-b6fc-62f60dcec74e', 'volume_size': 1} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-598757100',display_name='tempest-VolumesGetTest-Volume-1375894458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb56836d-fec5-4416-b6fc-62f60dcec74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bb994d66804db29575355949b9d7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:15Z,use_quota=True,user_id='d81bd7d5deaf4b3fbe619218d2f68dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Creating volume bb56836d-fec5-4416-b6fc-62f60dcec74e {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:15 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bb56836d-fec5-4416-b6fc-62f60dcec74e 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_df40s2cydevstack@QuobyteHD" returned: 0 in 0.537s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 was qcow2, converting to qcow2 {{(pid=86874) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:55:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_df40s2cydevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:15 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bb56836d-fec5-4416-b6fc-62f60dcec74e 1073741824 Sep 25 10:55:15 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:15 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_df40s2cydevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 Sep 25 10:55:15 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:16 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bb56836d-fec5-4416-b6fc-62f60dcec74e 1073741824" returned: 0 in 0.566s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bb56836d-fec5-4416-b6fc-62f60dcec74e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:16 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bb56836d-fec5-4416-b6fc-62f60dcec74e Sep 25 10:55:16 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:16 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bb56836d-fec5-4416-b6fc-62f60dcec74e" returned: 0 in 0.322s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:55:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3176bda-4639-4788-a46a-8a9d8f19a205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb56836d-fec5-4416-b6fc-62f60dcec74e', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c016bd5-0597-4142-9c1c-cb6cdd9efb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:16 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Volume volume-bb56836d-fec5-4416-b6fc-62f60dcec74e (bb56836d-fec5-4416-b6fc-62f60dcec74e): created successfully Sep 25 10:55:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c016bd5-0597-4142-9c1c-cb6cdd9efb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Flow 'volume_create_manager' (c45170a6-ceb5-4652-8c54-6c2a058aab55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5e07fc2b-2a65-4f2d-896e-7ab36b7e3f32 tempest-VolumesGetTest-1419671931 None] Created volume successfully. Sep 25 10:55:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-bb56836d-fec5-4416-b6fc-62f60dcec74e-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Lock "cinder-bb56836d-fec5-4416-b6fc-62f60dcec74e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-quobyte-bb56836d-fec5-4416-b6fc-62f60dcec74e" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-bb56836d-fec5-4416-b6fc-62f60dcec74e" acquired by "delete_volume" :: waited 0.015s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:17 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[858ae7a9-2eb4-49bd-a3e7-5841be554892]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bb56836d-fec5-4416-b6fc-62f60dcec74e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:18 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bb56836d-fec5-4416-b6fc-62f60dcec74e Sep 25 10:55:18 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:18 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_df40s2cydevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2" returned: 0 in 2.388s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_df40s2cydevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:55:18 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Converted 112.00 MB image at 46.87 MB/s Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:18 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 1G Sep 25 10:55:18 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:18 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bb56836d-fec5-4416-b6fc-62f60dcec74e" returned: 0 in 0.433s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bb56836d-fec5-4416-b6fc-62f60dcec74e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:18 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bb56836d-fec5-4416-b6fc-62f60dcec74e Sep 25 10:55:18 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:18 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 1G" returned: 0 in 0.388s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Downloaded image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}])) to volume 872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 successfully. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Temporary image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 for user 3c5e711338df4e4abaa517fe6ee88e63 is deleted. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Marking volume 872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 as bootable. {{(pid=86874) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Copying metadata from image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 to 872b9e4a-42ab-46bd-83b2-1bd15d8b70f2. {{(pid=86874) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Creating volume glance metadata for volume 872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 backed by image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86874) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073efb4a-5697-4a39-ad02-fb0616c0f365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d66ed7-8da3-4eed-a2fe-a64f03683354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:18 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Volume volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 (872b9e4a-42ab-46bd-83b2-1bd15d8b70f2): created successfully Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d66ed7-8da3-4eed-a2fe-a64f03683354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Flow 'volume_create_manager' (229bd518-d40a-4966-8f78-988d2b324b30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:18 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-86453ef7-f9d5-40a0-b39d-0cb7e39ddddf tempest-VolumesExtendTest-1685694702 None] Created volume successfully. Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bb56836d-fec5-4416-b6fc-62f60dcec74e" returned: 0 in 0.319s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-bb56836d-fec5-4416-b6fc-62f60dcec74e" released by "delete_volume" :: held 0.806s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Created reservations ['3b6478ff-deba-40df-8454-6eaf4d3043e2', 'dd6dd9b2-8c06-4880-a33f-916018b63db4', '47888108-0c20-4b09-8b20-71f916fa0caa', '82c040db-c2d0-4e7e-8f13-cd89f0b0e672'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:18 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:55:18 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-4c4c8899-5279-46ab-a654-489eb66fd935-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:19 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3d007b64-b6ad-42f0-8070-cc1c41d718b0 tempest-VolumesExtendTest-1685694702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3d007b64-b6ad-42f0-8070-cc1c41d718b0 tempest-VolumesExtendTest-1685694702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Lock "cinder-4c4c8899-5279-46ab-a654-489eb66fd935-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.334s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:19 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Deleted volume successfully. Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b336b5-ad07-4b03-8680-e98b40662116]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3d007b64-b6ad-42f0-8070-cc1c41d718b0 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-quobyte-4c4c8899-5279-46ab-a654-489eb66fd935" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-47ad5131-fda6-4f58-aef2-6928dd24b1c1 tempest-VolumesGetTest-1419671931 None] Lock "cinder-bb56836d-fec5-4416-b6fc-62f60dcec74e-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-4c4c8899-5279-46ab-a654-489eb66fd935" acquired by "delete_volume" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf34316-aabc-42df-b9ce-88954f30d08e]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4c4c8899-5279-46ab-a654-489eb66fd935 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:19 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 Sep 25 10:55:19 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:19 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4c4c8899-5279-46ab-a654-489eb66fd935 Sep 25 10:55:19 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:19 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3d007b64-b6ad-42f0-8070-cc1c41d718b0 tempest-VolumesExtendTest-1685694702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2" returned: 0 in 0.556s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3d007b64-b6ad-42f0-8070-cc1c41d718b0 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 2G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:19 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4c4c8899-5279-46ab-a654-489eb66fd935" returned: 0 in 0.484s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4c4c8899-5279-46ab-a654-489eb66fd935 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:19 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4c4c8899-5279-46ab-a654-489eb66fd935 Sep 25 10:55:19 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3d007b64-b6ad-42f0-8070-cc1c41d718b0 tempest-VolumesExtendTest-1685694702 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 2G" returned: 0 in 0.140s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3d007b64-b6ad-42f0-8070-cc1c41d718b0 tempest-VolumesExtendTest-1685694702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.742s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:19 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-3d007b64-b6ad-42f0-8070-cc1c41d718b0 tempest-VolumesExtendTest-1685694702 None] Extend volume completed successfully. Sep 25 10:55:20 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-4c4c8899-5279-46ab-a654-489eb66fd935" returned: 0 in 0.335s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-4c4c8899-5279-46ab-a654-489eb66fd935" released by "delete_volume" :: held 0.866s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Created reservations ['d678dea8-1ee5-4b75-afc5-4d6fe9689959', 'd87cbf1a-1009-4f1b-a596-a5a7879c8430', '0295622d-aa7d-4e4e-9c14-3145062b20b8', 'da3fbd4d-2a78-4fab-a145-b0fc0fec39fc'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:20 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:55:20 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Acquiring lock "cinder-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:20 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.466s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Lock "cinder-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:20 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Deleted volume successfully. Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ba8d803f-9d3f-4ac0-b83a-7370f4178754 tempest-VolumesGetTest-1419671931 None] Lock "cinder-4c4c8899-5279-46ab-a654-489eb66fd935-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Acquiring lock "cinder-quobyte-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Lock "cinder-quobyte-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2" acquired by "delete_volume" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fafaac-ff60-4552-9bc0-b9f1bb1670b8]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:21 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 Sep 25 10:55:21 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Flow 'volume_create_manager' (6b5cf351-274e-4347-a3ec-25b1c7934d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64535a1b-8f75-4ebe-9565-bb1d21af9d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64535a1b-8f75-4ebe-9565-bb1d21af9d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1559825467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed56f3f2-300b-4e36-afcd-5998750ce109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bb994d66804db29575355949b9d7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:21Z,use_quota=True,user_id='d81bd7d5deaf4b3fbe619218d2f68dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8414631c-4910-4394-aca0-c368d608d310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8414631c-4910-4394-aca0-c368d608d310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f933e3f-0a68-4459-b346-0c115667e2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f933e3f-0a68-4459-b346-0c115667e2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed56f3f2-300b-4e36-afcd-5998750ce109', 'volume_name': 'volume-ed56f3f2-300b-4e36-afcd-5998750ce109', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d37a02a-2234-4532-a6e9-f00b125b85d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d37a02a-2234-4532-a6e9-f00b125b85d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e2a655-7bda-49c2-b790-258cbd70677f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:21 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Volume ed56f3f2-300b-4e36-afcd-5998750ce109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed56f3f2-300b-4e36-afcd-5998750ce109', 'volume_size': 1} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1559825467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed56f3f2-300b-4e36-afcd-5998750ce109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bb994d66804db29575355949b9d7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:21Z,use_quota=True,user_id='d81bd7d5deaf4b3fbe619218d2f68dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Creating volume ed56f3f2-300b-4e36-afcd-5998750ce109 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:21 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:21 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 1073741824 Sep 25 10:55:21 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:21 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2" returned: 0 in 0.479s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:21 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2 Sep 25 10:55:21 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:21 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2" returned: 0 in 0.318s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Lock "cinder-quobyte-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2" released by "delete_volume" :: held 0.848s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Created reservations ['0eed40f7-0213-4572-956b-3791c44500ac', '94ad2de5-62a9-4aac-8fa9-755bc0faf55f', '86829b34-16ff-43eb-8691-5c9affdce1e7', '82f974ce-8ed8-4f64-8a86-44dcdd698dde'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:21 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 1073741824" returned: 0 in 0.695s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:21 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:55:21 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:22 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 Sep 25 10:55:22 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:22 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.353s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:22 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Deleted volume successfully. Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-e57f0947-d336-4027-b4fe-877ab26c95a9 tempest-VolumesExtendTest-1685694702 None] Lock "cinder-872b9e4a-42ab-46bd-83b2-1bd15d8b70f2-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:22 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109" returned: 0 in 0.454s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e2a655-7bda-49c2-b790-258cbd70677f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed56f3f2-300b-4e36-afcd-5998750ce109', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c7ead4-26d1-463b-964d-ed6af396ef3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:22 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Volume volume-ed56f3f2-300b-4e36-afcd-5998750ce109 (ed56f3f2-300b-4e36-afcd-5998750ce109): created successfully Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c7ead4-26d1-463b-964d-ed6af396ef3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Flow 'volume_create_manager' (6b5cf351-274e-4347-a3ec-25b1c7934d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:22 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5412d570-743f-41d5-b062-0c39cf7cfa0c tempest-VolumesGetTest-1419671931 None] Created volume successfully. Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Flow 'volume_create_manager' (f86e3742-efe8-44e3-a89f-7d9ebc6f2597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d464f5c-cc9c-4a01-acc5-bba12abc5260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d464f5c-cc9c-4a01-acc5-bba12abc5260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1279970139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90e1adc-f529-44ea-af44-0621fba34557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a4f09f055d949a29d106a704438bf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:23Z,use_quota=True,user_id='3c5e711338df4e4abaa517fe6ee88e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c896e50-9c42-49fc-a95d-1344299a02f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c896e50-9c42-49fc-a95d-1344299a02f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd68925-ef3b-4d24-a5b4-bc906d6208d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd68925-ef3b-4d24-a5b4-bc906d6208d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e90e1adc-f529-44ea-af44-0621fba34557', 'volume_name': 'volume-e90e1adc-f529-44ea-af44-0621fba34557', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09eedae2-8023-47ec-861c-b1fada2e15ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09eedae2-8023-47ec-861c-b1fada2e15ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1d6f6f-2d1d-4903-a798-8c126da3f24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:22 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Volume e90e1adc-f529-44ea-af44-0621fba34557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e90e1adc-f529-44ea-af44-0621fba34557', 'volume_size': 1} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1279970139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90e1adc-f529-44ea-af44-0621fba34557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a4f09f055d949a29d106a704438bf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:23Z,use_quota=True,user_id='3c5e711338df4e4abaa517fe6ee88e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Creating volume e90e1adc-f529-44ea-af44-0621fba34557 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:22 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:55:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:22 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 1073741824 Sep 25 10:55:22 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:23 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 1073741824" returned: 0 in 0.561s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:23 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 Sep 25 10:55:23 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:23 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557" returned: 0 in 0.379s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:55:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1d6f6f-2d1d-4903-a798-8c126da3f24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e90e1adc-f529-44ea-af44-0621fba34557', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656abeb7-3cd3-460d-961d-288eac7dfa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:23 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Volume volume-e90e1adc-f529-44ea-af44-0621fba34557 (e90e1adc-f529-44ea-af44-0621fba34557): created successfully Sep 25 10:55:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656abeb7-3cd3-460d-961d-288eac7dfa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Flow 'volume_create_manager' (f86e3742-efe8-44e3-a89f-7d9ebc6f2597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-410db283-0360-4346-b8f3-03006bc6ee15 tempest-VolumesExtendTest-1685694702 None] Created volume successfully. Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Flow 'volume_create_manager' (ee046001-1d22-47ca-abe2-88c9d962ae19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988a64a2-869e-49e3-8477-3f612c1f74b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988a64a2-869e-49e3-8477-3f612c1f74b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-148866818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65282e86-e6ae-498d-b014-bc0cdfe7a508,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='21bb994d66804db29575355949b9d7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ed56f3f2-300b-4e36-afcd-5998750ce109,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:24Z,use_quota=True,user_id='d81bd7d5deaf4b3fbe619218d2f68dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b5e8cd-6574-44fb-a3cf-95635ef3e630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b5e8cd-6574-44fb-a3cf-95635ef3e630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d5c804-efff-45b0-9231-8674d2357cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d5c804-efff-45b0-9231-8674d2357cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '65282e86-e6ae-498d-b014-bc0cdfe7a508', 'volume_name': 'volume-65282e86-e6ae-498d-b014-bc0cdfe7a508', 'volume_size': 1, 'source_volid': 'ed56f3f2-300b-4e36-afcd-5998750ce109', 'source_volstatus': 'available'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a32ff6-1c2e-4555-8896-f030a4237fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a32ff6-1c2e-4555-8896-f030a4237fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f56c58-00fa-45fc-b2a1-ae45afd43ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:24 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Volume 65282e86-e6ae-498d-b014-bc0cdfe7a508: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-65282e86-e6ae-498d-b014-bc0cdfe7a508', 'volume_size': 1, 'source_volid': 'ed56f3f2-300b-4e36-afcd-5998750ce109', 'source_volstatus': 'available'} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:24 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Cloning volume ed56f3f2-300b-4e36-afcd-5998750ce109 to volume 65282e86-e6ae-498d-b014-bc0cdfe7a508 Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Creating offline snapshot 570c1f3d-8113-46c0-a723-d079aa63c428 of volume ed56f3f2-300b-4e36-afcd-5998750ce109 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed732fb1-5986-44dc-a0d5-02f58ffd9091]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:24 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 Sep 25 10:55:24 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:24 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109" returned: 0 in 0.385s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:24 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 1G Sep 25 10:55:24 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:25 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 1G" returned: 0 in 0.439s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed56f3f2-300b-4e36-afcd-5998750ce109 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:25 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed56f3f2-300b-4e36-afcd-5998750ce109 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 Sep 25 10:55:25 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:25 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed56f3f2-300b-4e36-afcd-5998750ce109 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428" returned: 0 in 0.358s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:25 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 is being set with open permissions: ugo+rw Sep 25 10:55:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:25 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 Sep 25 10:55:25 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:25 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428" returned: 0 in 0.280s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:25 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.info Sep 25 10:55:25 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:26 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.info" returned: 0 in 0.265s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:26 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.info is being set with open permissions: ugo+rw Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:26 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.info Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:26 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:26 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:55:26 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:26 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.info" returned: 0 in 0.333s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-quobyte-65282e86-e6ae-498d-b014-bc0cdfe7a508" by "_copy_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-65282e86-e6ae-498d-b014-bc0cdfe7a508" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] snapshot: 570c1f3d-8113-46c0-a723-d079aa63c428, volume: 65282e86-e6ae-498d-b014-bc0cdfe7a508, {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:55:26 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.369s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf3dc90-a8ae-471e-8a30-e9f07194d548]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:26 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 Sep 25 10:55:26 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:26 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428" returned: 0 in 0.379s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed56f3f2-300b-4e36-afcd-5998750ce109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4327715b-f477-411b-b950-26d3c23b792f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:27 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 Sep 25 10:55:27 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:27 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109" returned: 0 in 0.510s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] will copy from snapshot at /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:55:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Creating direct copy from snapshot {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:55:27 devstack cinder-volume[86874]: DEBUG cinder.utils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Path /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508 not found in is_blk_device check {{(pid=86874) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 10:55:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:27 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508 Sep 25 10:55:27 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:34 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508" returned: 0 in 7.247s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:34 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109, size 1024.00 MB, duration 7.25 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:55:34 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Converted 1024.00 MB image at 141.28 MB/s Sep 25 10:55:34 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508 is being set with open permissions: ugo+rw Sep 25 10:55:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:34 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508 Sep 25 10:55:34 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:34 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508" returned: 0 in 0.256s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-65282e86-e6ae-498d-b014-bc0cdfe7a508" released by "_copy_volume_from_snapshot" :: held 8.492s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-quobyte-570c1f3d-8113-46c0-a723-d079aa63c428" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-570c1f3d-8113-46c0-a723-d079aa63c428" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Deleting offline snapshot 570c1f3d-8113-46c0-a723-d079aa63c428 of volume ed56f3f2-300b-4e36-afcd-5998750ce109 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:55:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] snapshot_file for this snap is: volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:55:35 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa90a4b-02ae-44e4-99db-5a5685f2752e]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:35 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 Sep 25 10:55:35 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:35 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428" returned: 0 in 0.391s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed56f3f2-300b-4e36-afcd-5998750ce109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:55:35 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0e12b4-8ea1-4557-aa9f-cf15ba0ed4b0]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:35 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 Sep 25 10:55:35 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:35 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=47,cinder:INSERT=17,cinder:DELETE=5,cinder:SELECT=42 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:55:35 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109" returned: 0 in 0.526s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:35 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 Sep 25 10:55:35 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:36 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428" returned: 0 in 0.354s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:36 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428 Sep 25 10:55:36 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:36 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109.570c1f3d-8113-46c0-a723-d079aa63c428" returned: 0 in 0.280s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-570c1f3d-8113-46c0-a723-d079aa63c428" released by "_delete_snapshot" :: held 1.668s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.445s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.772s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] Creating offline snapshot 0d6032d5-37bb-455d-ab7e-e6bc897723bb of volume e90e1adc-f529-44ea-af44-0621fba34557 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f56c58-00fa-45fc-b2a1-ae45afd43ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65282e86-e6ae-498d-b014-bc0cdfe7a508', 'volume_size': 1, 'source_volid': 'ed56f3f2-300b-4e36-afcd-5998750ce109', 'source_volstatus': 'available'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d391e3f6-bc19-4ca1-b2bf-eb2e865d3884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[74457a80-c2f2-4a59-bcd5-7eae2711ebd0]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:36 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Volume volume-65282e86-e6ae-498d-b014-bc0cdfe7a508 (65282e86-e6ae-498d-b014-bc0cdfe7a508): created successfully Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d391e3f6-bc19-4ca1-b2bf-eb2e865d3884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Flow 'volume_create_manager' (ee046001-1d22-47ca-abe2-88c9d962ae19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:36 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b13002d5-f734-422f-839c-90fc1feb673b tempest-VolumesGetTest-1419671931 None] Created volume successfully. Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Flow 'volume_create_manager' (6a3bb484-2eaa-4700-9dbf-5f70e6bd97d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:36 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 Sep 25 10:55:36 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ce1d17-8e36-4d80-a4e2-848b393103b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ce1d17-8e36-4d80-a4e2-848b393103b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f31fa3-16fe-4f65-914d-3244f331e619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9cb0530cdda4248b8b53477d4085030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:37Z,use_quota=True,user_id='7b1794a4c07547ada78de09c78b7dcba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2275b559-49d9-4721-b54b-14f0836e5fb7),volume_type_id=2275b559-49d9-4721-b54b-14f0836e5fb7)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290acf78-fa30-49c6-8d8b-93b178b9742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290acf78-fa30-49c6-8d8b-93b178b9742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a6b493-f226-4ae3-95c8-2eb41b53b5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:36 devstack cinder-volume[86874]: DEBUG cinder.image.glance [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Creating Keystone auth plugin from conf {{(pid=86874) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:55:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a6b493-f226-4ae3-95c8-2eb41b53b5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '92f31fa3-16fe-4f65-914d-3244f331e619', 'volume_name': 'volume-92f31fa3-16fe-4f65-914d-3244f331e619', 'volume_size': 1, 'image_id': '7b131752-0456-4b56-ba2e-83dc4dfae77b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b131752-0456-4b56-ba2e-83dc4dfae77b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4c21340409ee3e788a245838fb730f69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b9cb0530cdda4248b8b53477d4085030', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bdc8f1f38598430acd12c9f5bf60b0ac82452fa17d3b52f8b62fd8c0d8ba631c12df84fffd822094e1ab9dc62eadf3535d67fd1582c0bd3f8c0e51c982e3c1e1', 'id': '7b131752-0456-4b56-ba2e-83dc4dfae77b', 'created_at': datetime.datetime(2026, 9, 25, 8, 55, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 55, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b131752-0456-4b56-ba2e-83dc4dfae77b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a002015-e521-490f-a61f-938ea098e2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a002015-e521-490f-a61f-938ea098e2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:37 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4344375-1f8b-4cd9-8213-6967d5152546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:37 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Volume 92f31fa3-16fe-4f65-914d-3244f331e619: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-92f31fa3-16fe-4f65-914d-3244f331e619', 'volume_size': 1, 'image_id': '7b131752-0456-4b56-ba2e-83dc4dfae77b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b131752-0456-4b56-ba2e-83dc4dfae77b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4c21340409ee3e788a245838fb730f69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b9cb0530cdda4248b8b53477d4085030', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bdc8f1f38598430acd12c9f5bf60b0ac82452fa17d3b52f8b62fd8c0d8ba631c12df84fffd822094e1ab9dc62eadf3535d67fd1582c0bd3f8c0e51c982e3c1e1', 'id': '7b131752-0456-4b56-ba2e-83dc4dfae77b', 'created_at': datetime.datetime(2026, 9, 25, 8, 55, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 55, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b131752-0456-4b56-ba2e-83dc4dfae77b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 10:55:37 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Trying to clone 92f31fa3-16fe-4f65-914d-3244f331e619 from image 7b131752-0456-4b56-ba2e-83dc4dfae77b at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b131752-0456-4b56-ba2e-83dc4dfae77b', 'metadata': {}}]). {{(pid=86874) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:55:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557" returned: 0 in 0.414s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:37 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb 1G Sep 25 10:55:37 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:37 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:55:37 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Image download 0.00 MB at 0.00 MB/s Sep 25 10:55:37 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dd050c-e55b-445c-a245-fb6e96e5d39e]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:37 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD Sep 25 10:55:37 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:37 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb 1G" returned: 0 in 0.517s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e90e1adc-f529-44ea-af44-0621fba34557 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:37 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e90e1adc-f529-44ea-af44-0621fba34557 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb Sep 25 10:55:37 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:37 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:37 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD Sep 25 10:55:37 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:38 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e90e1adc-f529-44ea-af44-0621fba34557 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb" returned: 0 in 0.384s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:38 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb is being set with open permissions: ugo+rw Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:38 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb Sep 25 10:55:38 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:38 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD" returned: 1 in 0.440s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Temporary image 7b131752-0456-4b56-ba2e-83dc4dfae77b is fetched for user 7b1794a4c07547ada78de09c78b7dcba. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9016e7f1-ecc0-4335-831d-34652034f019]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:38 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Flow 'volume_create_manager' (6f219b7e-53ad-4cd8-aeb5-5de73679a208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ffbaa3-a1df-4cad-b655-8f41610c147b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb" returned: 0 in 0.339s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ffbaa3-a1df-4cad-b655-8f41610c147b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-682797557',display_name='tempest-VolumesGetTest-Volume-87810644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113ad21f-32b1-4fa9-9390-8a69444e0c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bb994d66804db29575355949b9d7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:38Z,use_quota=True,user_id='d81bd7d5deaf4b3fbe619218d2f68dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed686ca1-fe44-40be-9a29-a3b21116c150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed686ca1-fe44-40be-9a29-a3b21116c150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fcc87d0-7c5c-463f-a661-9d50a3dd8ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fcc87d0-7c5c-463f-a661-9d50a3dd8ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '113ad21f-32b1-4fa9-9390-8a69444e0c79', 'volume_name': 'volume-113ad21f-32b1-4fa9-9390-8a69444e0c79', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cebb0d1-2b22-42ec-a130-54337ca74ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cebb0d1-2b22-42ec-a130-54337ca74ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2cba9e8-fcb4-411f-83c5-755d0b8334bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:38 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Volume 113ad21f-32b1-4fa9-9390-8a69444e0c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-113ad21f-32b1-4fa9-9390-8a69444e0c79', 'volume_size': 1} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:38 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD Sep 25 10:55:38 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:38 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.info Sep 25 10:55:38 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:38 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:38 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.info" returned: 0 in 0.268s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:38 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.info is being set with open permissions: ugo+rw Sep 25 10:55:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:38 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.info Sep 25 10:55:38 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:38 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD Sep 25 10:55:38 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:39 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.info" returned: 0 in 0.290s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.622s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-682797557',display_name='tempest-VolumesGetTest-Volume-87810644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113ad21f-32b1-4fa9-9390-8a69444e0c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bb994d66804db29575355949b9d7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:38Z,use_quota=True,user_id='d81bd7d5deaf4b3fbe619218d2f68dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Creating volume 113ad21f-32b1-4fa9-9390-8a69444e0c79 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:39 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:39 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-113ad21f-32b1-4fa9-9390-8a69444e0c79 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:39 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-113ad21f-32b1-4fa9-9390-8a69444e0c79 1073741824 Sep 25 10:55:39 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:39 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d39516ba-9a97-4dae-893a-fa0780c98235 tempest-VolumesExtendTest-1685694702 None] Create snapshot completed successfully Sep 25 10:55:39 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-113ad21f-32b1-4fa9-9390-8a69444e0c79 1073741824" returned: 0 in 0.463s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-113ad21f-32b1-4fa9-9390-8a69444e0c79 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:39 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-113ad21f-32b1-4fa9-9390-8a69444e0c79 Sep 25 10:55:39 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ef84e036-77cd-4ab1-8d89-cf9b20f16be5 tempest-VolumesExtendTest-1685694702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:39 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-113ad21f-32b1-4fa9-9390-8a69444e0c79" returned: 0 in 0.293s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.784s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f31fa3-16fe-4f65-914d-3244f331e619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9cb0530cdda4248b8b53477d4085030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:37Z,use_quota=True,user_id='7b1794a4c07547ada78de09c78b7dcba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2275b559-49d9-4721-b54b-14f0836e5fb7),volume_type_id=2275b559-49d9-4721-b54b-14f0836e5fb7)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Creating volume 92f31fa3-16fe-4f65-914d-3244f331e619 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:39 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2cba9e8-fcb4-411f-83c5-755d0b8334bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-113ad21f-32b1-4fa9-9390-8a69444e0c79', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:39 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 1073741824 Sep 25 10:55:39 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48dda07a-ecd2-44f9-b6ed-f90ef2eb6ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:39 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Volume volume-113ad21f-32b1-4fa9-9390-8a69444e0c79 (113ad21f-32b1-4fa9-9390-8a69444e0c79): created successfully Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48dda07a-ecd2-44f9-b6ed-f90ef2eb6ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Flow 'volume_create_manager' (6f219b7e-53ad-4cd8-aeb5-5de73679a208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:39 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f33675bd-6e07-46e0-a30d-82e1e0dc21fd tempest-VolumesGetTest-1419671931 None] Created volume successfully. Sep 25 10:55:40 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 1073741824" returned: 0 in 0.470s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:40 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 Sep 25 10:55:40 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-113ad21f-32b1-4fa9-9390-8a69444e0c79-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Lock "cinder-113ad21f-32b1-4fa9-9390-8a69444e0c79-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-quobyte-113ad21f-32b1-4fa9-9390-8a69444e0c79" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-113ad21f-32b1-4fa9-9390-8a69444e0c79" acquired by "delete_volume" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e945d7d-e077-486d-bda8-c95fa775eec6]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-113ad21f-32b1-4fa9-9390-8a69444e0c79 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:40 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619" returned: 0 in 0.279s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ef84e036-77cd-4ab1-8d89-cf9b20f16be5 tempest-VolumesExtendTest-1685694702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.893s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[958a675c-08b8-492c-971f-44e29e258e40]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ef84e036-77cd-4ab1-8d89-cf9b20f16be5 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Attempting download of 7b131752-0456-4b56-ba2e-83dc4dfae77b ((None, [{'url': 'file:///opt/stack/data/glance/images/7b131752-0456-4b56-ba2e-83dc4dfae77b', 'metadata': {}}])) to volume 92f31fa3-16fe-4f65-914d-3244f331e619. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 10:55:40 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-113ad21f-32b1-4fa9-9390-8a69444e0c79 Sep 25 10:55:40 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[380cb95b-c7da-43a8-be93-48a0b3be1241]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b131752-0456-4b56-ba2e-83dc4dfae77b_e9sxe4el {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:40 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 Sep 25 10:55:40 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:40 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b131752-0456-4b56-ba2e-83dc4dfae77b_e9sxe4el Sep 25 10:55:40 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:41 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-113ad21f-32b1-4fa9-9390-8a69444e0c79" returned: 0 in 0.443s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-113ad21f-32b1-4fa9-9390-8a69444e0c79 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:41 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-113ad21f-32b1-4fa9-9390-8a69444e0c79 Sep 25 10:55:41 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:41 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ef84e036-77cd-4ab1-8d89-cf9b20f16be5 tempest-VolumesExtendTest-1685694702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557" returned: 0 in 0.440s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ef84e036-77cd-4ab1-8d89-cf9b20f16be5 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb 2G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:41 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b131752-0456-4b56-ba2e-83dc4dfae77b_e9sxe4el" returned: 0 in 0.393s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b131752-0456-4b56-ba2e-83dc4dfae77b_e9sxe4el {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:41 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b131752-0456-4b56-ba2e-83dc4dfae77b_e9sxe4el Sep 25 10:55:41 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ef84e036-77cd-4ab1-8d89-cf9b20f16be5 tempest-VolumesExtendTest-1685694702 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb 2G" returned: 0 in 0.138s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ef84e036-77cd-4ab1-8d89-cf9b20f16be5 tempest-VolumesExtendTest-1685694702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.628s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:41 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ef84e036-77cd-4ab1-8d89-cf9b20f16be5 tempest-VolumesExtendTest-1685694702 None] Extend volume completed successfully. Sep 25 10:55:41 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-113ad21f-32b1-4fa9-9390-8a69444e0c79" returned: 0 in 0.337s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-113ad21f-32b1-4fa9-9390-8a69444e0c79" released by "delete_volume" :: held 0.826s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Created reservations ['d24eb850-3a75-48cb-9444-ff39332b0a92', '25042526-98ee-40d7-8d72-8641347f049b', '62ca31cd-12dd-4239-a378-3fce1ccd79a8', '103487fa-b89a-41f7-a677-e848b42ccdd5'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:41 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b131752-0456-4b56-ba2e-83dc4dfae77b_e9sxe4el" returned: 1 in 0.378s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b131752-0456-4b56-ba2e-83dc4dfae77b_e9sxe4el' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7510772b-423e-4a4f-8f21-7fcee606cae9]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:41 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:55:41 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:41 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD Sep 25 10:55:41 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-65282e86-e6ae-498d-b014-bc0cdfe7a508-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Lock "cinder-65282e86-e6ae-498d-b014-bc0cdfe7a508-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-quobyte-65282e86-e6ae-498d-b014-bc0cdfe7a508" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-65282e86-e6ae-498d-b014-bc0cdfe7a508" acquired by "delete_volume" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:41 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.338s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:41 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Deleted volume successfully. Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc3ecab-2a1a-468d-8c78-d8759744a388]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-78fd369c-7c8b-44d1-8c7f-89f51bb80e4c tempest-VolumesGetTest-1419671931 None] Lock "cinder-113ad21f-32b1-4fa9-9390-8a69444e0c79-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:42 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508 Sep 25 10:55:42 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:42 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Acquiring lock "cinder-0d6032d5-37bb-455d-ab7e-e6bc897723bb-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:42 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Lock "cinder-0d6032d5-37bb-455d-ab7e-e6bc897723bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:42 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Acquiring lock "cinder-quobyte-e90e1adc-f529-44ea-af44-0621fba34557" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Lock "cinder-quobyte-e90e1adc-f529-44ea-af44-0621fba34557" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Acquiring lock "cinder-quobyte-0d6032d5-37bb-455d-ab7e-e6bc897723bb" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Lock "cinder-quobyte-0d6032d5-37bb-455d-ab7e-e6bc897723bb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Deleting offline snapshot 0d6032d5-37bb-455d-ab7e-e6bc897723bb of volume e90e1adc-f529-44ea-af44-0621fba34557 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] snapshot_file for this snap is: volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7a93c5-24d4-4a3e-9c74-c7917213e703]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:42 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508" returned: 0 in 0.435s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:42 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508 Sep 25 10:55:42 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:42 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb Sep 25 10:55:42 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:42 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD" returned: 1 in 0.452s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] 7b131752-0456-4b56-ba2e-83dc4dfae77b was raw, converting to qcow2 {{(pid=86874) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:42 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 Sep 25 10:55:42 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:42 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-65282e86-e6ae-498d-b014-bc0cdfe7a508" returned: 0 in 0.313s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-65282e86-e6ae-498d-b014-bc0cdfe7a508" released by "delete_volume" :: held 0.826s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Created reservations ['4e7200cc-afd5-44b9-8ab3-dfaf60b694df', '2a1defe7-9cb4-4044-b54d-e843b228a193', 'f2eba765-91f8-4ce4-b448-a9c7ecc5b643', '44d6efff-f6ed-49d8-b801-47356a76322d'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:42 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb" returned: 0 in 0.548s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e90e1adc-f529-44ea-af44-0621fba34557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[87db5f28-50e3-426f-82a7-abc53b962738]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:43 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:55:43 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:43 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 Sep 25 10:55:43 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-ed56f3f2-300b-4e36-afcd-5998750ce109-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Lock "cinder-ed56f3f2-300b-4e36-afcd-5998750ce109-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:43 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-quobyte-ed56f3f2-300b-4e36-afcd-5998750ce109" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619" returned: 0 in 0.747s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b131752-0456-4b56-ba2e-83dc4dfae77b_luz150rmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:55:43 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:43 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 1G Sep 25 10:55:43 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-ed56f3f2-300b-4e36-afcd-5998750ce109" acquired by "delete_volume" :: waited 0.049s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:43 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.416s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ddb612-1b2f-4650-a638-9e80c96be518]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:43 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Deleted volume successfully. Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-93adcf0e-0e7e-4744-9918-a4a1efd52968 tempest-VolumesGetTest-1419671931 None] Lock "cinder-65282e86-e6ae-498d-b014-bc0cdfe7a508-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:43 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 Sep 25 10:55:43 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:43 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557" returned: 0 in 0.653s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:43 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb Sep 25 10:55:43 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:43 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 1G" returned: 0 in 0.404s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Downloaded image 7b131752-0456-4b56-ba2e-83dc4dfae77b ((None, [{'url': 'file:///opt/stack/data/glance/images/7b131752-0456-4b56-ba2e-83dc4dfae77b', 'metadata': {}}])) to volume 92f31fa3-16fe-4f65-914d-3244f331e619 successfully. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Temporary image 7b131752-0456-4b56-ba2e-83dc4dfae77b for user 7b1794a4c07547ada78de09c78b7dcba is deleted. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Marking volume 92f31fa3-16fe-4f65-914d-3244f331e619 as bootable. {{(pid=86874) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Copying metadata from image 7b131752-0456-4b56-ba2e-83dc4dfae77b to 92f31fa3-16fe-4f65-914d-3244f331e619. {{(pid=86874) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Creating volume glance metadata for volume 92f31fa3-16fe-4f65-914d-3244f331e619 backed by image 7b131752-0456-4b56-ba2e-83dc4dfae77b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7b131752-0456-4b56-ba2e-83dc4dfae77b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4c21340409ee3e788a245838fb730f69', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86874) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4344375-1f8b-4cd9-8213-6967d5152546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f31fa3-16fe-4f65-914d-3244f331e619', 'volume_size': 1, 'image_id': '7b131752-0456-4b56-ba2e-83dc4dfae77b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b131752-0456-4b56-ba2e-83dc4dfae77b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4c21340409ee3e788a245838fb730f69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b9cb0530cdda4248b8b53477d4085030', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bdc8f1f38598430acd12c9f5bf60b0ac82452fa17d3b52f8b62fd8c0d8ba631c12df84fffd822094e1ab9dc62eadf3535d67fd1582c0bd3f8c0e51c982e3c1e1', 'id': '7b131752-0456-4b56-ba2e-83dc4dfae77b', 'created_at': datetime.datetime(2026, 9, 25, 8, 55, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 55, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b131752-0456-4b56-ba2e-83dc4dfae77b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90b63c1-f0f4-44a6-8586-78da43167d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:43 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Volume volume-92f31fa3-16fe-4f65-914d-3244f331e619 (92f31fa3-16fe-4f65-914d-3244f331e619): created successfully Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90b63c1-f0f4-44a6-8586-78da43167d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Flow 'volume_create_manager' (6a3bb484-2eaa-4700-9dbf-5f70e6bd97d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:43 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b2158940-9386-4deb-92d2-a3323074bb8d tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Created volume successfully. Sep 25 10:55:43 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109" returned: 0 in 0.505s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:43 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109 Sep 25 10:55:43 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:44 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb" returned: 0 in 0.457s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:44 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb Sep 25 10:55:44 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:44 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-ed56f3f2-300b-4e36-afcd-5998750ce109" returned: 0 in 0.289s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-ed56f3f2-300b-4e36-afcd-5998750ce109" released by "delete_volume" :: held 0.881s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Created reservations ['36bb3316-25d5-48ce-97bf-27c5135fe22a', '67b20ba6-4443-42d8-a815-b6dad6362055', '5c3dc88c-ac0d-4a36-9303-6d965422186d', '9b3fc236-fbbe-4acb-bc79-751efd5faee4'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:44 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557.0d6032d5-37bb-455d-ab7e-e6bc897723bb" returned: 0 in 0.357s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:44 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:55:44 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Lock "cinder-quobyte-0d6032d5-37bb-455d-ab7e-e6bc897723bb" released by "_delete_snapshot" :: held 2.217s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Lock "cinder-quobyte-e90e1adc-f529-44ea-af44-0621fba34557" released by "delete_snapshot" :: held 2.257s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Acquiring lock "cinder-92f31fa3-16fe-4f65-914d-3244f331e619-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Lock "cinder-92f31fa3-16fe-4f65-914d-3244f331e619-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Acquiring lock "cinder-quobyte-92f31fa3-16fe-4f65-914d-3244f331e619" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Lock "cinder-quobyte-92f31fa3-16fe-4f65-914d-3244f331e619" acquired by "delete_volume" :: waited 0.034s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Created reservations ['479f9487-6e2d-4783-9a4c-25fb9268c61f', '2261593a-0302-4023-bc67-d7b229718cb7', 'bebc0a38-0248-44f8-90e3-045f994e67ef', '4a838011-a310-43a2-bccf-f53f2b2bde2a'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f057fb-dfef-4ec5-856d-55abcde4fb64]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:44 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Delete snapshot completed successfully. Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-24da1f99-afc0-4cbe-a13e-f22a6ea8d310 tempest-VolumesExtendTest-1685694702 None] Lock "cinder-0d6032d5-37bb-455d-ab7e-e6bc897723bb-delete_snapshot" released by "delete_snapshot" :: held 2.582s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:44 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.418s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:44 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Deleted volume successfully. Sep 25 10:55:44 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 Sep 25 10:55:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-428210da-f9f9-432c-944f-a248dc86fcf1 tempest-VolumesGetTest-1419671931 None] Lock "cinder-ed56f3f2-300b-4e36-afcd-5998750ce109-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:44 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:45 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619" returned: 0 in 0.478s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:45 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619 Sep 25 10:55:45 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:45 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Flow 'volume_create_manager' (f4b1ca2a-1fd7-492e-acdb-2b2afa97a12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b44a6e-f7aa-42b0-9ff3-44dbe5cb57bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-92f31fa3-16fe-4f65-914d-3244f331e619" returned: 0 in 0.339s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b44a6e-f7aa-42b0-9ff3-44dbe5cb57bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2098250190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bdd064-a660-4799-bc1c-87eddb44b3e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='21bb994d66804db29575355949b9d7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:45Z,use_quota=True,user_id='d81bd7d5deaf4b3fbe619218d2f68dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6fd4d78-130d-4b8c-8733-47130e54f550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6fd4d78-130d-4b8c-8733-47130e54f550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97490f06-37fc-41af-84c5-e7e61ad3b9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.image.glance [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Creating Keystone auth plugin from conf {{(pid=86874) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Lock "cinder-quobyte-92f31fa3-16fe-4f65-914d-3244f331e619" released by "delete_volume" :: held 0.920s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Acquiring lock "cinder-e90e1adc-f529-44ea-af44-0621fba34557-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:45 devstack cinder-volume[86874]: WARNING cinder.quota [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:55:45 devstack cinder-volume[86874]: WARNING cinder.quota [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Lock "cinder-e90e1adc-f529-44ea-af44-0621fba34557-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Created reservations ['aeac724c-9315-4fc9-81b0-b57c8b62701e', '3be1f102-d41e-4174-a853-2097683cad06', '633158a9-8f31-4248-a70e-2e5050ebbd8e', '461a60b2-cd1f-40b1-ac04-ee3466f86555'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Acquiring lock "cinder-quobyte-e90e1adc-f529-44ea-af44-0621fba34557" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Lock "cinder-quobyte-e90e1adc-f529-44ea-af44-0621fba34557" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcfb0f3-20ef-44cb-b38d-888880970490]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:45 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:55:45 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97490f06-37fc-41af-84c5-e7e61ad3b9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3bdd064-a660-4799-bc1c-87eddb44b3e5', 'volume_name': 'volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b99281d-1d81-400f-a57b-39a3f3b15c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:45 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 Sep 25 10:55:45 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b99281d-1d81-400f-a57b-39a3f3b15c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf53cab-bd4d-44ff-b037-5141f1fc4a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:45 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Volume e3bdd064-a660-4799-bc1c-87eddb44b3e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 10:55:45 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Trying to clone e3bdd064-a660-4799-bc1c-87eddb44b3e5 from image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]). {{(pid=86874) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:55:46 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.303s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:46 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Deleted volume successfully. Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d3662f00-a12a-47ba-bbab-02228108598b tempest-VolumeAndVolumeTypeFromImageTest-1467556015 None] Lock "cinder-92f31fa3-16fe-4f65-914d-3244f331e619-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:46 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557" returned: 0 in 0.483s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:46 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557 Sep 25 10:55:46 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_4e6i8wtbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:55:46 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Image download 20.69 MB at 20.69 MB/s Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b97a6f-7bc3-4ba7-823b-1f3055e46973]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_4e6i8wtbdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:46 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_4e6i8wtbdevstack@QuobyteHD Sep 25 10:55:46 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:46 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e90e1adc-f529-44ea-af44-0621fba34557" returned: 0 in 0.301s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Lock "cinder-quobyte-e90e1adc-f529-44ea-af44-0621fba34557" released by "delete_volume" :: held 0.868s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Created reservations ['ed5d2d1c-c4b7-47e2-ac42-7f8dd47303ac', '8de819e5-c876-4c3b-b739-6e80f0925c5e', 'f727141f-89ff-4c1d-9bfa-f3079acf0a4a', 'd2fc4ea9-7944-484f-98d0-b9bb848e2023'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:46 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_4e6i8wtbdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Temporary image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 is fetched for user d81bd7d5deaf4b3fbe619218d2f68dfd. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:55:46 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:55:46 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f102bb9c-3d56-4060-a8c5-aacb9eff6026]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_4e6i8wtbdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:47 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_4e6i8wtbdevstack@QuobyteHD Sep 25 10:55:47 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:47 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.375s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:47 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Deleted volume successfully. Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8c2da821-bba5-4eaf-abb6-b378bccbc3b9 tempest-VolumesExtendTest-1685694702 None] Lock "cinder-e90e1adc-f529-44ea-af44-0621fba34557-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:47 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_4e6i8wtbdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2098250190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bdd064-a660-4799-bc1c-87eddb44b3e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='21bb994d66804db29575355949b9d7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:45Z,use_quota=True,user_id='d81bd7d5deaf4b3fbe619218d2f68dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Creating volume e3bdd064-a660-4799-bc1c-87eddb44b3e5 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:47 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:55:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:47 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 1073741824 Sep 25 10:55:47 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:48 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 1073741824" returned: 0 in 0.660s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:48 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 Sep 25 10:55:48 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:48 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5" returned: 0 in 0.292s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:55:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:48 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Attempting download of 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}])) to volume e3bdd064-a660-4799-bc1c-87eddb44b3e5. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 10:55:48 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec21990-a59f-4d8c-9aa6-f81d0aa8c856]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_8g93cbdi {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:48 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_8g93cbdi Sep 25 10:55:48 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:48 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_8g93cbdi" returned: 0 in 0.447s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_8g93cbdi {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:49 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_8g93cbdi Sep 25 10:55:49 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:49 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_8g93cbdi" returned: 1 in 0.425s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_8g93cbdi' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:55:49 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1446b3b8-cae5-433e-8e26-32590d37d3ee]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_4e6i8wtbdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:49 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_4e6i8wtbdevstack@QuobyteHD Sep 25 10:55:49 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:49 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_4e6i8wtbdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:49 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 was qcow2, converting to qcow2 {{(pid=86874) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:55:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_4e6i8wtbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:49 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_4e6i8wtbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 Sep 25 10:55:49 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Flow 'volume_create_manager' (5959eede-5400-45d5-8cc8-9330ce867277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a31d2e9-0999-47a8-9cee-a5150f0ae7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a31d2e9-0999-47a8-9cee-a5150f0ae7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1565794827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90b6173-84fe-45ed-8d74-88e8373bb18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657bf14ef0fa4a1184a28ddf79e13695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:52Z,use_quota=True,user_id='010c45342e3145fca5bd5fbe79bebe38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e5422a-66bf-4799-b495-538cae3dedcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e5422a-66bf-4799-b495-538cae3dedcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7abbf5-22a3-425c-94eb-00f8503a4ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7abbf5-22a3-425c-94eb-00f8503a4ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b90b6173-84fe-45ed-8d74-88e8373bb18d', 'volume_name': 'volume-b90b6173-84fe-45ed-8d74-88e8373bb18d', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e95f06-a43f-42cd-8d98-f9fb9c9e5f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e95f06-a43f-42cd-8d98-f9fb9c9e5f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a064466-459b-4083-9810-a790c32c0d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:52 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Volume b90b6173-84fe-45ed-8d74-88e8373bb18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b90b6173-84fe-45ed-8d74-88e8373bb18d', 'volume_size': 1} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1565794827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90b6173-84fe-45ed-8d74-88e8373bb18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657bf14ef0fa4a1184a28ddf79e13695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:52Z,use_quota=True,user_id='010c45342e3145fca5bd5fbe79bebe38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Creating volume b90b6173-84fe-45ed-8d74-88e8373bb18d {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:52 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b90b6173-84fe-45ed-8d74-88e8373bb18d 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:52 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b90b6173-84fe-45ed-8d74-88e8373bb18d 1073741824 Sep 25 10:55:52 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:52 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_4e6i8wtbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5" returned: 0 in 2.516s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_4e6i8wtbdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:55:52 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Converted 112.00 MB image at 44.49 MB/s Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:52 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 1G Sep 25 10:55:52 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:52 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 1G" returned: 0 in 0.416s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Downloaded image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}])) to volume e3bdd064-a660-4799-bc1c-87eddb44b3e5 successfully. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Temporary image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 for user d81bd7d5deaf4b3fbe619218d2f68dfd is deleted. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Marking volume e3bdd064-a660-4799-bc1c-87eddb44b3e5 as bootable. {{(pid=86874) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Copying metadata from image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 to e3bdd064-a660-4799-bc1c-87eddb44b3e5. {{(pid=86874) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Creating volume glance metadata for volume e3bdd064-a660-4799-bc1c-87eddb44b3e5 backed by image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86874) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:55:52 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b90b6173-84fe-45ed-8d74-88e8373bb18d 1073741824" returned: 0 in 0.579s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b90b6173-84fe-45ed-8d74-88e8373bb18d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf53cab-bd4d-44ff-b037-5141f1fc4a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:53 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b90b6173-84fe-45ed-8d74-88e8373bb18d Sep 25 10:55:53 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204e5843-66b6-48c0-b4c1-cdf541f09b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:53 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Volume volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 (e3bdd064-a660-4799-bc1c-87eddb44b3e5): created successfully Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204e5843-66b6-48c0-b4c1-cdf541f09b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Flow 'volume_create_manager' (f4b1ca2a-1fd7-492e-acdb-2b2afa97a12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:53 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-9f7ff363-cac3-4bbb-a3f7-6d8c824ac063 tempest-VolumesGetTest-1419671931 None] Created volume successfully. Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Flow 'volume_create_manager' (4dd6bc99-7913-4de9-85e2-c92523d9bcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7001a97-b831-4b9a-9b8d-e5f9cc501e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7001a97-b831-4b9a-9b8d-e5f9cc501e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1800291534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd29a1fd-7137-4373-ba8f-ccfd2415f6ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad988ab71e64288b4b4b022815834d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:53Z,use_quota=True,user_id='d7d7679d7d934c21b7af6f7a6998753e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4838d1b3-57cc-4ba7-9cc7-ea5e9a22cbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4838d1b3-57cc-4ba7-9cc7-ea5e9a22cbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7710ca5e-b962-403f-8c90-26aac3d0701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7710ca5e-b962-403f-8c90-26aac3d0701e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd29a1fd-7137-4373-ba8f-ccfd2415f6ac', 'volume_name': 'volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3c0b80-ffc0-460e-bbd6-7576b767f339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3c0b80-ffc0-460e-bbd6-7576b767f339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c234c87-ec56-4253-9204-4195ca454983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:53 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume cd29a1fd-7137-4373-ba8f-ccfd2415f6ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac', 'volume_size': 1} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:53 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b90b6173-84fe-45ed-8d74-88e8373bb18d" returned: 0 in 0.307s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.057s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1800291534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd29a1fd-7137-4373-ba8f-ccfd2415f6ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad988ab71e64288b4b4b022815834d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:53Z,use_quota=True,user_id='d7d7679d7d934c21b7af6f7a6998753e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Creating volume cd29a1fd-7137-4373-ba8f-ccfd2415f6ac {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:53 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a064466-459b-4083-9810-a790c32c0d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90b6173-84fe-45ed-8d74-88e8373bb18d', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:53 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac 1073741824 Sep 25 10:55:53 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a55b2cb-e83b-41da-a6bc-48e724a0915e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:53 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Volume volume-b90b6173-84fe-45ed-8d74-88e8373bb18d (b90b6173-84fe-45ed-8d74-88e8373bb18d): created successfully Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a55b2cb-e83b-41da-a6bc-48e724a0915e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Flow 'volume_create_manager' (5959eede-5400-45d5-8cc8-9330ce867277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:53 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4e0e635a-06b1-424a-8efc-ce5045c6337b tempest-VolumesNegativeTest-807148201 None] Created volume successfully. Sep 25 10:55:53 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac 1073741824" returned: 0 in 0.490s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:53 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac Sep 25 10:55:53 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:54 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac" returned: 0 in 0.267s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:55:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c234c87-ec56-4253-9204-4195ca454983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28edf69-c44c-458e-9cd6-055f9b464c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:54 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac (cd29a1fd-7137-4373-ba8f-ccfd2415f6ac): created successfully Sep 25 10:55:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28edf69-c44c-458e-9cd6-055f9b464c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Flow 'volume_create_manager' (4dd6bc99-7913-4de9-85e2-c92523d9bcd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:54 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5ebc4fee-e91f-4b22-968d-5c978972ab51 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Created volume successfully. Sep 25 10:55:54 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Flow 'volume_create_manager' (710348b2-fbd8-42ae-afde-19104a864c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeecd0cf-06c0-4edd-bf39-d85c5beede7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeecd0cf-06c0-4edd-bf39-d85c5beede7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1351561251',display_name='tempest-VolumesGetTest-Volume-1870264596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a3442a-fa19-4f34-a1ba-7952d1c4f288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bb994d66804db29575355949b9d7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:55Z,use_quota=True,user_id='d81bd7d5deaf4b3fbe619218d2f68dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8c9be7-59a8-4ff4-ad19-40667c42854d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8c9be7-59a8-4ff4-ad19-40667c42854d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d68688f-4941-4c4b-a16f-cda27e7360c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d68688f-4941-4c4b-a16f-cda27e7360c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a3442a-fa19-4f34-a1ba-7952d1c4f288', 'volume_name': 'volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0d9cc3-2f84-46ef-8fd2-989f00540e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0d9cc3-2f84-46ef-8fd2-989f00540e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130124c1-d932-4e71-8c24-ff6eb2f4b024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:55 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Volume 03a3442a-fa19-4f34-a1ba-7952d1c4f288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288', 'volume_size': 1} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1351561251',display_name='tempest-VolumesGetTest-Volume-1870264596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a3442a-fa19-4f34-a1ba-7952d1c4f288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bb994d66804db29575355949b9d7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:55Z,use_quota=True,user_id='d81bd7d5deaf4b3fbe619218d2f68dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Creating volume 03a3442a-fa19-4f34-a1ba-7952d1c4f288 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:55 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:55 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288 1073741824 Sep 25 10:55:55 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:55 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288 1073741824" returned: 0 in 0.603s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:55 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288 Sep 25 10:55:55 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Flow 'volume_create_manager' (bbd6606c-6710-4296-bbc7-63ce6d7cc057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81fac63e-5f77-4e81-8b41-40d584466484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81fac63e-5f77-4e81-8b41-40d584466484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1713540159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965fc9e7-b59a-4c7f-9600-3db085162566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad988ab71e64288b4b4b022815834d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:56Z,use_quota=True,user_id='d7d7679d7d934c21b7af6f7a6998753e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e24d7e-944a-465f-987e-4e881c342d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e24d7e-944a-465f-987e-4e881c342d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc08f632-7067-4b94-9014-93bc2232935d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc08f632-7067-4b94-9014-93bc2232935d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '965fc9e7-b59a-4c7f-9600-3db085162566', 'volume_name': 'volume-965fc9e7-b59a-4c7f-9600-3db085162566', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4170329-a8c5-43be-b6f0-1a310b8a016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4170329-a8c5-43be-b6f0-1a310b8a016d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5cceb7-505f-4337-9b18-64a0dd837db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:56 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume 965fc9e7-b59a-4c7f-9600-3db085162566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-965fc9e7-b59a-4c7f-9600-3db085162566', 'volume_size': 1} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:56 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288" returned: 0 in 0.445s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1713540159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965fc9e7-b59a-4c7f-9600-3db085162566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad988ab71e64288b4b4b022815834d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:56Z,use_quota=True,user_id='d7d7679d7d934c21b7af6f7a6998753e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Creating volume 965fc9e7-b59a-4c7f-9600-3db085162566 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:56 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-965fc9e7-b59a-4c7f-9600-3db085162566 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130124c1-d932-4e71-8c24-ff6eb2f4b024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:56 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-965fc9e7-b59a-4c7f-9600-3db085162566 1073741824 Sep 25 10:55:56 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bdb967-ca5d-4f4d-aa0d-aebc5b94a3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:56 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Volume volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288 (03a3442a-fa19-4f34-a1ba-7952d1c4f288): created successfully Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bdb967-ca5d-4f4d-aa0d-aebc5b94a3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Flow 'volume_create_manager' (710348b2-fbd8-42ae-afde-19104a864c2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:56 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a627eee2-80b5-4d47-846c-e0a4e9728deb tempest-VolumesGetTest-1419671931 None] Created volume successfully. Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Flow 'volume_create_manager' (f032a6bc-f34f-4bcc-a10b-4d92e8c3d277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46881836-d0dd-4cbe-8b57-67ecaa3dd40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46881836-d0dd-4cbe-8b57-67ecaa3dd40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-934798319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb84168f-7b56-4b52-b0d1-371b81365417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad988ab71e64288b4b4b022815834d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:56Z,use_quota=True,user_id='d7d7679d7d934c21b7af6f7a6998753e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b98247e-83d4-46ec-af02-7d039f254fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b98247e-83d4-46ec-af02-7d039f254fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814eec6c-16a1-428a-810d-3a52035fb8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814eec6c-16a1-428a-810d-3a52035fb8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb84168f-7b56-4b52-b0d1-371b81365417', 'volume_name': 'volume-cb84168f-7b56-4b52-b0d1-371b81365417', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c06feb-6ae8-443d-917c-0f800403f7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c06feb-6ae8-443d-917c-0f800403f7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e6c1ba-7fa6-4f95-81df-491f978967b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:56 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume cb84168f-7b56-4b52-b0d1-371b81365417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb84168f-7b56-4b52-b0d1-371b81365417', 'volume_size': 1} Sep 25 10:55:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:57 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-965fc9e7-b59a-4c7f-9600-3db085162566 1073741824" returned: 0 in 1.002s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Flow 'volume_create_manager' (4e9f2ba1-008d-4570-9df4-010b9ed9694e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad83d5e0-616a-491d-9456-8835d27f37fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-965fc9e7-b59a-4c7f-9600-3db085162566 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:57 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-965fc9e7-b59a-4c7f-9600-3db085162566 Sep 25 10:55:57 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad83d5e0-616a-491d-9456-8835d27f37fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1291708190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13714712-6f70-43f9-8e3c-214d68841efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad988ab71e64288b4b4b022815834d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:57Z,use_quota=True,user_id='d7d7679d7d934c21b7af6f7a6998753e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d345bd1-f129-474c-be25-4f2285f1da9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d345bd1-f129-474c-be25-4f2285f1da9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5778977b-005e-4aac-bb16-339df497f982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5778977b-005e-4aac-bb16-339df497f982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13714712-6f70-43f9-8e3c-214d68841efd', 'volume_name': 'volume-13714712-6f70-43f9-8e3c-214d68841efd', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756a3dd3-7151-435b-b518-20739d0b9577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756a3dd3-7151-435b-b518-20739d0b9577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1006682-e615-4fc0-b6f1-afb6c6b141d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:57 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume 13714712-6f70-43f9-8e3c-214d68841efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13714712-6f70-43f9-8e3c-214d68841efd', 'volume_size': 1} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-03a3442a-fa19-4f34-a1ba-7952d1c4f288-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Lock "cinder-03a3442a-fa19-4f34-a1ba-7952d1c4f288-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-quobyte-03a3442a-fa19-4f34-a1ba-7952d1c4f288" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-03a3442a-fa19-4f34-a1ba-7952d1c4f288" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[514596a9-f715-4661-8c05-fe3d512af9c2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:57 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-965fc9e7-b59a-4c7f-9600-3db085162566" returned: 0 in 0.554s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.118s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-934798319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb84168f-7b56-4b52-b0d1-371b81365417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad988ab71e64288b4b4b022815834d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:56Z,use_quota=True,user_id='d7d7679d7d934c21b7af6f7a6998753e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Creating volume cb84168f-7b56-4b52-b0d1-371b81365417 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:57 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:55:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cb84168f-7b56-4b52-b0d1-371b81365417 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:57 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288 Sep 25 10:55:57 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:57 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cb84168f-7b56-4b52-b0d1-371b81365417 1073741824 Sep 25 10:55:57 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5cceb7-505f-4337-9b18-64a0dd837db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-965fc9e7-b59a-4c7f-9600-3db085162566', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5628ed1f-8604-46fc-8874-56e4d167e69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:58 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume volume-965fc9e7-b59a-4c7f-9600-3db085162566 (965fc9e7-b59a-4c7f-9600-3db085162566): created successfully Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5628ed1f-8604-46fc-8874-56e4d167e69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Flow 'volume_create_manager' (bbd6606c-6710-4296-bbc7-63ce6d7cc057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:58 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ab2dc0b3-f6a0-4386-8dda-f03f079e4427 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Created volume successfully. Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Flow 'volume_create_manager' (f6823ca2-17c0-48cf-8960-0b41bb3413fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025620cb-a6bc-4bcf-9a47-0c1f47c66339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025620cb-a6bc-4bcf-9a47-0c1f47c66339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2146626130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2a8f70-758c-4b8f-be00-47a8b379655e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad988ab71e64288b4b4b022815834d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:58Z,use_quota=True,user_id='d7d7679d7d934c21b7af6f7a6998753e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f58c721-085f-45b1-9ea2-659bfc527dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f58c721-085f-45b1-9ea2-659bfc527dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9f64fd-991f-49ac-b8ee-917463d6a183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9f64fd-991f-49ac-b8ee-917463d6a183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2a8f70-758c-4b8f-be00-47a8b379655e', 'volume_name': 'volume-fd2a8f70-758c-4b8f-be00-47a8b379655e', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ad6e37-0b11-4ac4-ab09-11d01a4afd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ad6e37-0b11-4ac4-ab09-11d01a4afd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70d059a-2b34-4716-9043-ac9dd05e097f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:58 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume fd2a8f70-758c-4b8f-be00-47a8b379655e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2a8f70-758c-4b8f-be00-47a8b379655e', 'volume_size': 1} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:58 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288" returned: 0 in 0.739s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:58 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288 Sep 25 10:55:58 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:58 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cb84168f-7b56-4b52-b0d1-371b81365417 1073741824" returned: 0 in 0.710s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cb84168f-7b56-4b52-b0d1-371b81365417 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:58 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cb84168f-7b56-4b52-b0d1-371b81365417 Sep 25 10:55:58 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Flow 'volume_create_manager' (7e84a197-c511-4798-be76-2b406a2063a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b35939-c6dc-48c4-8c72-a514ad0cd8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b35939-c6dc-48c4-8c72-a514ad0cd8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1951507575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3525d1e7-ac95-40b6-a99c-4cdd9334f999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad988ab71e64288b4b4b022815834d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:59Z,use_quota=True,user_id='d7d7679d7d934c21b7af6f7a6998753e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8b3810-adfb-4a9e-90ae-2e35d07c64a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:59 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8b3810-adfb-4a9e-90ae-2e35d07c64a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b837131-3df3-4c17-9558-0075337344e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b837131-3df3-4c17-9558-0075337344e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3525d1e7-ac95-40b6-a99c-4cdd9334f999', 'volume_name': 'volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c10e8a7-242d-4263-9e7c-f25f3706fbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c10e8a7-242d-4263-9e7c-f25f3706fbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee955af0-0d72-4d27-8324-06fa0ef0b587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:59 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume 3525d1e7-ac95-40b6-a99c-4cdd9334f999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999', 'volume_size': 1} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03a3442a-fa19-4f34-a1ba-7952d1c4f288" returned: 0 in 0.671s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:59 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cb84168f-7b56-4b52-b0d1-371b81365417" returned: 0 in 0.431s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-03a3442a-fa19-4f34-a1ba-7952d1c4f288" released by "delete_volume" :: held 1.511s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.679s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1291708190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13714712-6f70-43f9-8e3c-214d68841efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad988ab71e64288b4b4b022815834d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:57Z,use_quota=True,user_id='d7d7679d7d934c21b7af6f7a6998753e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Creating volume 13714712-6f70-43f9-8e3c-214d68841efd {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:59 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-13714712-6f70-43f9-8e3c-214d68841efd 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:59 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-13714712-6f70-43f9-8e3c-214d68841efd 1073741824 Sep 25 10:55:59 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e6c1ba-7fa6-4f95-81df-491f978967b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb84168f-7b56-4b52-b0d1-371b81365417', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef5b4cd-9143-4b00-a623-e1061f7be89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:59 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume volume-cb84168f-7b56-4b52-b0d1-371b81365417 (cb84168f-7b56-4b52-b0d1-371b81365417): created successfully Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef5b4cd-9143-4b00-a623-e1061f7be89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Flow 'volume_create_manager' (f032a6bc-f34f-4bcc-a10b-4d92e8c3d277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:59 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2279251c-9cc1-4949-aab5-2aed789da1a9 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Created volume successfully. Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Created reservations ['f27fac95-9250-458d-ad84-427e9090b1ed', '64980dbc-4813-467c-bd3c-b8d7d9590fed', '145216a4-6fcb-4437-ac3b-2245a9ee25ff', '5cc0c41c-8a66-4f61-b0dd-9820c52ac626'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:59 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:55:59 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:59 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.322s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:59 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Deleted volume successfully. Sep 25 10:55:59 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-13714712-6f70-43f9-8e3c-214d68841efd 1073741824" returned: 0 in 0.585s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7166d0e0-ca2f-43ce-af27-339fee2017d7 tempest-VolumesGetTest-1419671931 None] Lock "cinder-03a3442a-fa19-4f34-a1ba-7952d1c4f288-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-13714712-6f70-43f9-8e3c-214d68841efd {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:59 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-13714712-6f70-43f9-8e3c-214d68841efd Sep 25 10:55:59 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-e3bdd064-a660-4799-bc1c-87eddb44b3e5-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Lock "cinder-e3bdd064-a660-4799-bc1c-87eddb44b3e5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Acquiring lock "cinder-quobyte-e3bdd064-a660-4799-bc1c-87eddb44b3e5" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:00 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-13714712-6f70-43f9-8e3c-214d68841efd" returned: 0 in 0.312s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.736s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2146626130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2a8f70-758c-4b8f-be00-47a8b379655e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad988ab71e64288b4b4b022815834d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:58Z,use_quota=True,user_id='d7d7679d7d934c21b7af6f7a6998753e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Creating volume fd2a8f70-758c-4b8f-be00-47a8b379655e {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:56:00 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fd2a8f70-758c-4b8f-be00-47a8b379655e 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-e3bdd064-a660-4799-bc1c-87eddb44b3e5" acquired by "delete_volume" :: waited 0.047s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:00 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fd2a8f70-758c-4b8f-be00-47a8b379655e 1073741824 Sep 25 10:56:00 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1006682-e615-4fc0-b6f1-afb6c6b141d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13714712-6f70-43f9-8e3c-214d68841efd', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4fe7fd-8b87-4b32-90a1-feb4007dd1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0be3c5-33ee-4012-933b-8d632a25ab24]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:00 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume volume-13714712-6f70-43f9-8e3c-214d68841efd (13714712-6f70-43f9-8e3c-214d68841efd): created successfully Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4fe7fd-8b87-4b32-90a1-feb4007dd1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Flow 'volume_create_manager' (4e9f2ba1-008d-4570-9df4-010b9ed9694e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:00 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b0c0a3dd-747a-4da6-9976-948a01bd419c tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Created volume successfully. Sep 25 10:56:00 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 Sep 25 10:56:00 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:00 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5" returned: 0 in 0.515s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:00 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fd2a8f70-758c-4b8f-be00-47a8b379655e 1073741824" returned: 0 in 0.584s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:00 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5 Sep 25 10:56:00 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fd2a8f70-758c-4b8f-be00-47a8b379655e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:00 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fd2a8f70-758c-4b8f-be00-47a8b379655e Sep 25 10:56:00 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:01 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3bdd064-a660-4799-bc1c-87eddb44b3e5" returned: 0 in 0.319s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Lock "cinder-quobyte-e3bdd064-a660-4799-bc1c-87eddb44b3e5" released by "delete_volume" :: held 0.896s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:01 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fd2a8f70-758c-4b8f-be00-47a8b379655e" returned: 0 in 0.344s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.039s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1951507575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3525d1e7-ac95-40b6-a99c-4cdd9334f999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad988ab71e64288b4b4b022815834d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:59Z,use_quota=True,user_id='d7d7679d7d934c21b7af6f7a6998753e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Creating volume 3525d1e7-ac95-40b6-a99c-4cdd9334f999 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:56:01 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Created reservations ['a3b9f93c-ca95-41bb-9595-6a3980dba40b', '236761d6-4268-4a32-b358-110236909d5e', '920cde54-fc7f-4bed-9c3b-795b54f6182c', 'e4da942d-380f-46ae-8cbf-5f39b77f2236'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:01 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999 1073741824 Sep 25 10:56:01 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70d059a-2b34-4716-9043-ac9dd05e097f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2a8f70-758c-4b8f-be00-47a8b379655e', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e0ef28-62b2-45ea-89eb-3bfd703b880d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:01 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume volume-fd2a8f70-758c-4b8f-be00-47a8b379655e (fd2a8f70-758c-4b8f-be00-47a8b379655e): created successfully Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e0ef28-62b2-45ea-89eb-3bfd703b880d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Flow 'volume_create_manager' (f6823ca2-17c0-48cf-8960-0b41bb3413fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:01 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-17905863-f601-4687-bd0d-0261d3d17c40 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Created volume successfully. Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:01 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:56:01 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:01 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.350s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:01 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Deleted volume successfully. Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-485c57b3-cbcb-48ed-b9f4-270057a7f449 tempest-VolumesGetTest-1419671931 None] Lock "cinder-e3bdd064-a660-4799-bc1c-87eddb44b3e5-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:01 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999 1073741824" returned: 0 in 0.719s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:02 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999 Sep 25 10:56:02 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999" returned: 0 in 0.299s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:02 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:56:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:02 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee955af0-0d72-4d27-8324-06fa0ef0b587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258ab434-f35c-4151-a84d-9cbfc86e6929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:02 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Volume volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999 (3525d1e7-ac95-40b6-a99c-4cdd9334f999): created successfully Sep 25 10:56:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258ab434-f35c-4151-a84d-9cbfc86e6929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Flow 'volume_create_manager' (7e84a197-c511-4798-be76-2b406a2063a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:02 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8039dd1b-15c6-480d-a3e8-6479ee5f9ab6 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Created volume successfully. Sep 25 10:56:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "cinder-3525d1e7-ac95-40b6-a99c-4cdd9334f999-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-3525d1e7-ac95-40b6-a99c-4cdd9334f999-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "cinder-quobyte-3525d1e7-ac95-40b6-a99c-4cdd9334f999" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-quobyte-3525d1e7-ac95-40b6-a99c-4cdd9334f999" acquired by "delete_volume" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:04 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e99434c-0791-4477-986b-1f809c6fadad]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:04 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999 Sep 25 10:56:04 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:04 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999" returned: 0 in 0.407s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:04 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999 Sep 25 10:56:04 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:04 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3525d1e7-ac95-40b6-a99c-4cdd9334f999" returned: 0 in 0.404s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-quobyte-3525d1e7-ac95-40b6-a99c-4cdd9334f999" released by "delete_volume" :: held 0.871s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:04 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Created reservations ['596c376a-6613-418b-8a92-a14a30a8eae0', '2077082c-2d1d-4deb-8395-febc7dd4fcb7', '16777b49-ea70-47b2-b7bd-160e017080e0', '251ddc38-0d56-4fb6-a0f0-c413ababfd9e'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:05 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:56:05 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "cinder-fd2a8f70-758c-4b8f-be00-47a8b379655e-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-fd2a8f70-758c-4b8f-be00-47a8b379655e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "cinder-quobyte-fd2a8f70-758c-4b8f-be00-47a8b379655e" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-quobyte-fd2a8f70-758c-4b8f-be00-47a8b379655e" acquired by "delete_volume" :: waited 0.034s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ff2328-e271-4954-b9b3-827ae7ca4208]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fd2a8f70-758c-4b8f-be00-47a8b379655e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:05 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.515s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:05 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Deleted volume successfully. Sep 25 10:56:05 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fd2a8f70-758c-4b8f-be00-47a8b379655e Sep 25 10:56:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b23b61fb-71b1-4ed0-8834-bb416df9f1e5 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-3525d1e7-ac95-40b6-a99c-4cdd9334f999-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:05 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:06 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fd2a8f70-758c-4b8f-be00-47a8b379655e" returned: 0 in 0.642s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fd2a8f70-758c-4b8f-be00-47a8b379655e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:06 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fd2a8f70-758c-4b8f-be00-47a8b379655e Sep 25 10:56:06 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:06 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fd2a8f70-758c-4b8f-be00-47a8b379655e" returned: 0 in 0.391s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:06 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-quobyte-fd2a8f70-758c-4b8f-be00-47a8b379655e" released by "delete_volume" :: held 1.127s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:06 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Created reservations ['cbf11f60-3163-4935-a1b6-6167aa6f3115', '53eb688f-021f-4a11-a650-2d65f1dd7cf2', 'cb360e76-9dc7-494b-948e-c2737806062b', '700c9970-67bb-41f1-b752-04752aa05c12'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:06 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:56:06 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:07 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.295s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:07 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:07 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Deleted volume successfully. Sep 25 10:56:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f03c06fd-5570-4aa0-a419-175f7e10376f tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-fd2a8f70-758c-4b8f-be00-47a8b379655e-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "cinder-13714712-6f70-43f9-8e3c-214d68841efd-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-13714712-6f70-43f9-8e3c-214d68841efd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:07 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=142,cinder:UPDATE=174,cinder:INSERT=54,cinder:DELETE=17 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:56:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "cinder-quobyte-13714712-6f70-43f9-8e3c-214d68841efd" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-quobyte-13714712-6f70-43f9-8e3c-214d68841efd" acquired by "delete_volume" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:07 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e372b4dc-6345-4844-a66c-03e6e8e20668]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-13714712-6f70-43f9-8e3c-214d68841efd {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:07 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-13714712-6f70-43f9-8e3c-214d68841efd Sep 25 10:56:07 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:08 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-13714712-6f70-43f9-8e3c-214d68841efd" returned: 0 in 0.495s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-13714712-6f70-43f9-8e3c-214d68841efd {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:08 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-13714712-6f70-43f9-8e3c-214d68841efd Sep 25 10:56:08 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:08 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-13714712-6f70-43f9-8e3c-214d68841efd" returned: 0 in 0.322s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-quobyte-13714712-6f70-43f9-8e3c-214d68841efd" released by "delete_volume" :: held 0.889s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Flow 'volume_create_manager' (37b99748-a589-437f-acef-8fc7ea695f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97dd6360-08de-4d50-b971-41a977d4bfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97dd6360-08de-4d50-b971-41a977d4bfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-533099521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590613b6-4687-413e-8a23-0f6e5932b922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b87702bf4704337bbbfba5500f892fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:09Z,use_quota=True,user_id='0864d41bf37e43469968f50fd61e4111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519d73ff-6f0f-4c88-a8f1-7f1d082c0eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519d73ff-6f0f-4c88-a8f1-7f1d082c0eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87ea680-484b-487c-94ed-446575ab9485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87ea680-484b-487c-94ed-446575ab9485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '590613b6-4687-413e-8a23-0f6e5932b922', 'volume_name': 'volume-590613b6-4687-413e-8a23-0f6e5932b922', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf322a3-bc7d-4173-b310-8f9c6a32e2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf322a3-bc7d-4173-b310-8f9c6a32e2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7be3da5-c3ea-414d-af13-6e7e0a424068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:08 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Volume 590613b6-4687-413e-8a23-0f6e5932b922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-590613b6-4687-413e-8a23-0f6e5932b922', 'volume_size': 1} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-533099521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590613b6-4687-413e-8a23-0f6e5932b922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b87702bf4704337bbbfba5500f892fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:09Z,use_quota=True,user_id='0864d41bf37e43469968f50fd61e4111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Creating volume 590613b6-4687-413e-8a23-0f6e5932b922 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:56:08 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Created reservations ['e7a93298-3503-48ee-8fc2-8f0a171d3b30', '22b69d27-05f4-49f1-b8b3-8913a7d9c8ed', '1dff4d4d-f3d9-4fa1-ab50-3b1226ae3aaf', '28a46094-78d5-455f-96bb-d09180a7358f'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:08 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922 1073741824 Sep 25 10:56:08 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:08 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:56:08 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:09 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.324s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:09 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Deleted volume successfully. Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7fad1395-a8fe-4425-873e-f730171d0943 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-13714712-6f70-43f9-8e3c-214d68841efd-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:09 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922 1073741824" returned: 0 in 0.661s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:09 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922 Sep 25 10:56:09 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:09 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922" returned: 0 in 0.298s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7be3da5-c3ea-414d-af13-6e7e0a424068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-590613b6-4687-413e-8a23-0f6e5932b922', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11f41aa-6cd9-465e-83bc-7f5c038f9189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:09 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Volume volume-590613b6-4687-413e-8a23-0f6e5932b922 (590613b6-4687-413e-8a23-0f6e5932b922): created successfully Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11f41aa-6cd9-465e-83bc-7f5c038f9189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Flow 'volume_create_manager' (37b99748-a589-437f-acef-8fc7ea695f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:09 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ff15e390-a359-49b6-aa9e-d2a23f7cc052 tempest-VolumesSnapshotListTestJSON-1201721726 None] Created volume successfully. Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "cinder-cb84168f-7b56-4b52-b0d1-371b81365417-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-cb84168f-7b56-4b52-b0d1-371b81365417-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "cinder-quobyte-cb84168f-7b56-4b52-b0d1-371b81365417" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-quobyte-cb84168f-7b56-4b52-b0d1-371b81365417" acquired by "delete_volume" :: waited 0.018s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6e86d0-4502-4a61-b065-a4521bee04fc]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cb84168f-7b56-4b52-b0d1-371b81365417 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:10 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cb84168f-7b56-4b52-b0d1-371b81365417 Sep 25 10:56:10 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:10 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cb84168f-7b56-4b52-b0d1-371b81365417" returned: 0 in 0.403s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cb84168f-7b56-4b52-b0d1-371b81365417 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:10 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cb84168f-7b56-4b52-b0d1-371b81365417 Sep 25 10:56:10 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:10 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cb84168f-7b56-4b52-b0d1-371b81365417" returned: 0 in 0.292s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-quobyte-cb84168f-7b56-4b52-b0d1-371b81365417" released by "delete_volume" :: held 0.756s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Created reservations ['fd6d8eb7-5db9-4c10-9666-cfaa0fe77e5e', '9abd9221-6aef-45db-b872-eab4cf3b6f5f', '4f178bc7-2732-4afb-a653-d502c8edccd3', '0fce417a-e568-4c77-bff7-4ff17813e615'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:10 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:56:10 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:10 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Creating offline snapshot 6ad0236e-ecb2-4455-9bfc-150b97bfc241 of volume 590613b6-4687-413e-8a23-0f6e5932b922 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0bc3c2-7f9e-4f10-8dd7-70c6395ae3a4]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "cinder-965fc9e7-b59a-4c7f-9600-3db085162566-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-965fc9e7-b59a-4c7f-9600-3db085162566-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "cinder-quobyte-965fc9e7-b59a-4c7f-9600-3db085162566" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-quobyte-965fc9e7-b59a-4c7f-9600-3db085162566" acquired by "delete_volume" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:11 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922 Sep 25 10:56:11 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:11 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4fe40e-1f4d-47a9-af38-e780bc6505c5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-965fc9e7-b59a-4c7f-9600-3db085162566 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.324s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:11 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Deleted volume successfully. Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1781a826-e7ab-411e-b5b3-df9b49a19ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-cb84168f-7b56-4b52-b0d1-371b81365417-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:11 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-965fc9e7-b59a-4c7f-9600-3db085162566 Sep 25 10:56:11 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:11 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922" returned: 0 in 0.504s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:11 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 1G Sep 25 10:56:11 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:11 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-965fc9e7-b59a-4c7f-9600-3db085162566" returned: 0 in 0.443s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-965fc9e7-b59a-4c7f-9600-3db085162566 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:11 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-965fc9e7-b59a-4c7f-9600-3db085162566 Sep 25 10:56:11 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:11 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-965fc9e7-b59a-4c7f-9600-3db085162566" returned: 0 in 0.309s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-quobyte-965fc9e7-b59a-4c7f-9600-3db085162566" released by "delete_volume" :: held 0.821s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:12 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 1G" returned: 0 in 0.497s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590613b6-4687-413e-8a23-0f6e5932b922 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:12 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590613b6-4687-413e-8a23-0f6e5932b922 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 Sep 25 10:56:12 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Created reservations ['6051ca86-30da-495b-acca-7c2947672ad9', 'bd0616e7-b97d-40fb-a28d-55489022022b', 'be2642d3-e633-4ff0-a4cd-59a00fce7c5a', 'c1550472-a61d-4025-9ccb-9a5f6349187d'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:12 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:56:12 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "cinder-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "cinder-quobyte-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-quobyte-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4e7e70-9bf9-474b-9a2a-2c8b05c7a947]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:12 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590613b6-4687-413e-8a23-0f6e5932b922 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241" returned: 0 in 0.431s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:12 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 is being set with open permissions: ugo+rw Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:12 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 Sep 25 10:56:12 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:12 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac Sep 25 10:56:12 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:12 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.404s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:12 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Deleted volume successfully. Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ea0bfd26-b327-49e5-b4d1-7ade3819fc2e tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-965fc9e7-b59a-4c7f-9600-3db085162566-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:12 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241" returned: 0 in 0.311s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:12 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.info Sep 25 10:56:12 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:12 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac" returned: 0 in 0.433s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:12 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac Sep 25 10:56:12 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:13 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.info" returned: 0 in 0.318s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:13 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.info is being set with open permissions: ugo+rw Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:13 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.info Sep 25 10:56:13 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:13 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac" returned: 0 in 0.293s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-quobyte-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac" released by "delete_volume" :: held 0.800s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Created reservations ['e09616b8-4c45-4e41-89d5-558a090d43d2', '0adb5f97-77fc-4211-861a-fd20b46c4ce6', 'f0bd9da1-d5a1-4980-8e61-984163426da0', '6d4e4c4a-b728-45c7-8324-53bbffa9e691'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:13 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:56:13 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:13 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.info" returned: 0 in 0.282s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.485s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-0f714056-7628-4d6c-b3c3-7dc513fa18a7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Create snapshot completed successfully Sep 25 10:56:13 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.300s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Deleted volume successfully. Sep 25 10:56:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5b7389e3-7bd9-4e9d-a68f-7c2387eb7ad0 tempest-CreateVolumesFromSourceVolumeTest-1820097532 None] Lock "cinder-cd29a1fd-7137-4373-ba8f-ccfd2415f6ac-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] Creating offline snapshot 2dfb90e2-8357-4de4-bfc9-207616cea630 of volume 590613b6-4687-413e-8a23-0f6e5932b922 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:56:14 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4933bc8-7de8-45f3-84ed-efffb51ea347]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:14 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 Sep 25 10:56:14 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:14 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241" returned: 0 in 0.457s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-590613b6-4687-413e-8a23-0f6e5932b922(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:56:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:14 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 1G Sep 25 10:56:14 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:15 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 1G" returned: 0 in 0.589s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:15 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 Sep 25 10:56:15 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:15 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630" returned: 0 in 0.428s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:15 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 is being set with open permissions: ugo+rw Sep 25 10:56:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:15 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 Sep 25 10:56:15 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:16 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630" returned: 0 in 0.323s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-dbd7b074-dff9-4070-8d13-0647a3033e3d tempest-VolumesSnapshotListTestJSON-1201721726 None] Create snapshot completed successfully Sep 25 10:56:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] Creating offline snapshot 6a1d7bbf-c152-4922-857d-c180707ee470 of volume 590613b6-4687-413e-8a23-0f6e5932b922 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:56:16 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[671445b7-15bb-4cbe-aaff-4d15826ecc2b]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:17 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 Sep 25 10:56:17 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Acquiring lock "cinder-b90b6173-84fe-45ed-8d74-88e8373bb18d-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Lock "cinder-b90b6173-84fe-45ed-8d74-88e8373bb18d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Acquiring lock "cinder-quobyte-b90b6173-84fe-45ed-8d74-88e8373bb18d" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Lock "cinder-quobyte-b90b6173-84fe-45ed-8d74-88e8373bb18d" acquired by "delete_volume" :: waited 0.015s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:17 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[051d27b1-135b-4005-930e-03f6860f194a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b90b6173-84fe-45ed-8d74-88e8373bb18d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:17 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630" returned: 0 in 0.469s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-590613b6-4687-413e-8a23-0f6e5932b922(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:56:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:17 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 1G Sep 25 10:56:17 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:17 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b90b6173-84fe-45ed-8d74-88e8373bb18d Sep 25 10:56:17 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:17 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b90b6173-84fe-45ed-8d74-88e8373bb18d" returned: 0 in 0.486s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b90b6173-84fe-45ed-8d74-88e8373bb18d {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:17 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b90b6173-84fe-45ed-8d74-88e8373bb18d Sep 25 10:56:17 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:17 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 1G" returned: 0 in 0.579s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:18 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 Sep 25 10:56:18 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:18 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b90b6173-84fe-45ed-8d74-88e8373bb18d" returned: 0 in 0.326s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Lock "cinder-quobyte-b90b6173-84fe-45ed-8d74-88e8373bb18d" released by "delete_volume" :: held 0.868s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Created reservations ['0d0cf559-5034-4171-a835-1e60df714481', '15fd6c41-3853-469f-8017-2c81a0719036', 'ba11178e-cfe6-4249-a79d-e056ab452d29', 'd61ee322-58c3-4f54-bd70-3ed6043b24a4'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:18 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:56:18 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:18 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470" returned: 0 in 0.392s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:18 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 is being set with open permissions: ugo+rw Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:18 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 Sep 25 10:56:18 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:18 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.352s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Deleted volume successfully. Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7f819051-8968-49ad-bd9f-12fa57dcbe9e tempest-VolumesNegativeTest-807148201 None] Lock "cinder-b90b6173-84fe-45ed-8d74-88e8373bb18d-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:18 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470" returned: 0 in 0.348s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d6056d8f-010a-4ea9-8c64-a43e89cfdf5d tempest-VolumesSnapshotListTestJSON-1201721726 None] Create snapshot completed successfully Sep 25 10:56:20 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:56:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Flow 'volume_create_manager' (c2b12b47-2fbd-4c3d-a81e-8a8ea4c68413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b984ca73-ec3b-47b9-bc27-2bcddbd16d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b984ca73-ec3b-47b9-bc27-2bcddbd16d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907853f0-9250-4bf4-b3d7-03d2a10f0916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1cf0be7724b43b99ea1efea9b96483d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:20Z,use_quota=True,user_id='8f81ed0b9d424732966b4f7e78a7705e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d577638-f46f-4932-a8ec-4aad00b01ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d577638-f46f-4932-a8ec-4aad00b01ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cf748c-ebda-452a-b734-6a1f39c8488a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:20 devstack cinder-volume[86874]: DEBUG cinder.image.glance [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Creating Keystone auth plugin from conf {{(pid=86874) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:56:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cf748c-ebda-452a-b734-6a1f39c8488a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '907853f0-9250-4bf4-b3d7-03d2a10f0916', 'volume_name': 'volume-907853f0-9250-4bf4-b3d7-03d2a10f0916', 'volume_size': 1, 'image_id': '2157af39-a2fd-483d-a377-f53731d218a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2157af39-a2fd-483d-a377-f53731d218a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dada9e86c7503728be8e3733810c9b9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1cf0be7724b43b99ea1efea9b96483d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a6801dc1c0c6fb281995d4a392be6bc3f70355c9736744d7f1cce9afe08e21f356020c3ca8312fd8ed62a143208444178243cb7eba257e305522830009958e1', 'id': '2157af39-a2fd-483d-a377-f53731d218a3', 'created_at': datetime.datetime(2026, 9, 25, 8, 56, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 56, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2157af39-a2fd-483d-a377-f53731d218a3/file', 'properties': {}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f7a3e3-8c32-43df-8994-4b253602f3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f7a3e3-8c32-43df-8994-4b253602f3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a71220-0196-4910-9ae9-4377ae039aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:21 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Volume 907853f0-9250-4bf4-b3d7-03d2a10f0916: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-907853f0-9250-4bf4-b3d7-03d2a10f0916', 'volume_size': 1, 'image_id': '2157af39-a2fd-483d-a377-f53731d218a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2157af39-a2fd-483d-a377-f53731d218a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dada9e86c7503728be8e3733810c9b9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1cf0be7724b43b99ea1efea9b96483d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a6801dc1c0c6fb281995d4a392be6bc3f70355c9736744d7f1cce9afe08e21f356020c3ca8312fd8ed62a143208444178243cb7eba257e305522830009958e1', 'id': '2157af39-a2fd-483d-a377-f53731d218a3', 'created_at': datetime.datetime(2026, 9, 25, 8, 56, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 56, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2157af39-a2fd-483d-a377-f53731d218a3/file', 'properties': {}}, 'image_service': } Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Trying to clone 907853f0-9250-4bf4-b3d7-03d2a10f0916 from image 2157af39-a2fd-483d-a377-f53731d218a3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2157af39-a2fd-483d-a377-f53731d218a3', 'metadata': {}}]). {{(pid=86874) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "cinder-6a1d7bbf-c152-4922-857d-c180707ee470-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:56:21 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Image download 0.00 MB at 0.00 MB/s Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-6a1d7bbf-c152-4922-857d-c180707ee470-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "cinder-quobyte-590613b6-4687-413e-8a23-0f6e5932b922" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-quobyte-590613b6-4687-413e-8a23-0f6e5932b922" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "cinder-quobyte-6a1d7bbf-c152-4922-857d-c180707ee470" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-quobyte-6a1d7bbf-c152-4922-857d-c180707ee470" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Deleting offline snapshot 6a1d7bbf-c152-4922-857d-c180707ee470 of volume 590613b6-4687-413e-8a23-0f6e5932b922 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] snapshot_file for this snap is: volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cc313d-7a4d-466c-a9cb-6a652590b49f]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cf3468-91cc-4478-bba9-5ea4f823de94]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:21 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 Sep 25 10:56:21 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:21 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD Sep 25 10:56:21 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:21 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:21 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470" returned: 0 in 0.456s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-590613b6-4687-413e-8a23-0f6e5932b922(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebac0b25-30cc-4fc6-8a3d-fe876e37b954]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:21 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD Sep 25 10:56:21 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:21 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 Sep 25 10:56:21 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:22 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD" returned: 1 in 0.422s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:56:22 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Temporary image 2157af39-a2fd-483d-a377-f53731d218a3 is fetched for user 8f81ed0b9d424732966b4f7e78a7705e. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:56:22 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5d028f-20c7-4100-b3ff-d46358e4c19b]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:22 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630" returned: 0 in 0.519s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-590613b6-4687-413e-8a23-0f6e5932b922(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:56:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:22 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 Sep 25 10:56:22 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:22 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD Sep 25 10:56:22 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:22 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:22 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD Sep 25 10:56:22 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:22 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470" returned: 0 in 0.645s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:22 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470 Sep 25 10:56:22 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:23 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD" returned: 1 in 0.466s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907853f0-9250-4bf4-b3d7-03d2a10f0916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1cf0be7724b43b99ea1efea9b96483d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:20Z,use_quota=True,user_id='8f81ed0b9d424732966b4f7e78a7705e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Creating volume 907853f0-9250-4bf4-b3d7-03d2a10f0916 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:56:23 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:23 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 1073741824 Sep 25 10:56:23 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:23 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6a1d7bbf-c152-4922-857d-c180707ee470" returned: 0 in 0.362s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-quobyte-6a1d7bbf-c152-4922-857d-c180707ee470" released by "_delete_snapshot" :: held 2.142s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-quobyte-590613b6-4687-413e-8a23-0f6e5932b922" released by "delete_snapshot" :: held 2.177s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Created reservations ['f1324e9d-5502-483d-8faf-644c80fcfe3c', '3c3aa4f8-7d59-4630-8922-a90bf2edb9dd', '07c1a1f9-6568-4479-8956-2867bf4a6136', '51a37902-6e50-4b54-bae8-9f6a55948dd9'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Delete snapshot completed successfully. Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-98ddd069-6341-4643-8290-8db982b41fa7 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-6a1d7bbf-c152-4922-857d-c180707ee470-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:23 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 1073741824" returned: 0 in 0.627s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:23 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 Sep 25 10:56:23 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:24 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916" returned: 0 in 0.283s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Attempting download of 2157af39-a2fd-483d-a377-f53731d218a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/2157af39-a2fd-483d-a377-f53731d218a3', 'metadata': {}}])) to volume 907853f0-9250-4bf4-b3d7-03d2a10f0916. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceb21ef-700d-41cc-b3b7-3dd328788dc9]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2157af39-a2fd-483d-a377-f53731d218a3_55qbihoo {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "cinder-2dfb90e2-8357-4de4-bfc9-207616cea630-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:24 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2157af39-a2fd-483d-a377-f53731d218a3_55qbihoo Sep 25 10:56:24 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-2dfb90e2-8357-4de4-bfc9-207616cea630-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "cinder-quobyte-590613b6-4687-413e-8a23-0f6e5932b922" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-quobyte-590613b6-4687-413e-8a23-0f6e5932b922" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "cinder-quobyte-2dfb90e2-8357-4de4-bfc9-207616cea630" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-quobyte-2dfb90e2-8357-4de4-bfc9-207616cea630" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Deleting offline snapshot 2dfb90e2-8357-4de4-bfc9-207616cea630 of volume 590613b6-4687-413e-8a23-0f6e5932b922 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] snapshot_file for this snap is: volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d6d9f9-6ea5-485f-be66-69b73d224f3f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:24 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 Sep 25 10:56:24 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:24 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2157af39-a2fd-483d-a377-f53731d218a3_55qbihoo" returned: 0 in 0.493s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2157af39-a2fd-483d-a377-f53731d218a3_55qbihoo {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:24 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2157af39-a2fd-483d-a377-f53731d218a3_55qbihoo Sep 25 10:56:24 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:25 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630" returned: 0 in 0.542s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-590613b6-4687-413e-8a23-0f6e5932b922(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ba571c-a5b3-4870-8729-93d120522228]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:25 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2157af39-a2fd-483d-a377-f53731d218a3_55qbihoo" returned: 1 in 0.383s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2157af39-a2fd-483d-a377-f53731d218a3_55qbihoo' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c4995c-e3d9-4715-8b64-89e6cee9e94a]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:25 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 Sep 25 10:56:25 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:25 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD Sep 25 10:56:25 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:25 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241" returned: 0 in 0.403s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-590613b6-4687-413e-8a23-0f6e5932b922(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:25 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:25 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 Sep 25 10:56:25 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:25 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD Sep 25 10:56:25 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:25 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] 2157af39-a2fd-483d-a377-f53731d218a3 was raw, converting to qcow2 {{(pid=86874) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:56:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:25 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 Sep 25 10:56:25 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:26 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630" returned: 0 in 0.524s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:26 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630 Sep 25 10:56:26 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:26 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:56:26 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:26 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.2dfb90e2-8357-4de4-bfc9-207616cea630" returned: 0 in 0.386s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:26 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.348s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-quobyte-2dfb90e2-8357-4de4-bfc9-207616cea630" released by "_delete_snapshot" :: held 2.051s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-quobyte-590613b6-4687-413e-8a23-0f6e5932b922" released by "delete_snapshot" :: held 2.082s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:26 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916" returned: 0 in 0.569s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2157af39-a2fd-483d-a377-f53731d218a3_xecqzqzbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:56:26 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:26 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 1G Sep 25 10:56:26 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Created reservations ['daddd0db-bd24-4747-842d-1708fdcdaf77', 'ba793b7e-32c5-452e-bf58-c14108f717a5', 'fcd376a3-96bc-4072-981b-c7146f4d6cae', '01f06f6d-0db8-4801-b01e-b8090217e3c6'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:26 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Delete snapshot completed successfully. Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-32a6687a-1c9c-4aac-8115-3f53b32489c3 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-2dfb90e2-8357-4de4-bfc9-207616cea630-delete_snapshot" released by "delete_snapshot" :: held 2.289s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:26 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 1G" returned: 0 in 0.357s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Downloaded image 2157af39-a2fd-483d-a377-f53731d218a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/2157af39-a2fd-483d-a377-f53731d218a3', 'metadata': {}}])) to volume 907853f0-9250-4bf4-b3d7-03d2a10f0916 successfully. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Temporary image 2157af39-a2fd-483d-a377-f53731d218a3 for user 8f81ed0b9d424732966b4f7e78a7705e is deleted. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Marking volume 907853f0-9250-4bf4-b3d7-03d2a10f0916 as bootable. {{(pid=86874) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Copying metadata from image 2157af39-a2fd-483d-a377-f53731d218a3 to 907853f0-9250-4bf4-b3d7-03d2a10f0916. {{(pid=86874) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Creating volume glance metadata for volume 907853f0-9250-4bf4-b3d7-03d2a10f0916 backed by image 2157af39-a2fd-483d-a377-f53731d218a3 with: {'image_id': '2157af39-a2fd-483d-a377-f53731d218a3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'dada9e86c7503728be8e3733810c9b9b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86874) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a71220-0196-4910-9ae9-4377ae039aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-907853f0-9250-4bf4-b3d7-03d2a10f0916', 'volume_size': 1, 'image_id': '2157af39-a2fd-483d-a377-f53731d218a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2157af39-a2fd-483d-a377-f53731d218a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dada9e86c7503728be8e3733810c9b9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1cf0be7724b43b99ea1efea9b96483d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a6801dc1c0c6fb281995d4a392be6bc3f70355c9736744d7f1cce9afe08e21f356020c3ca8312fd8ed62a143208444178243cb7eba257e305522830009958e1', 'id': '2157af39-a2fd-483d-a377-f53731d218a3', 'created_at': datetime.datetime(2026, 9, 25, 8, 56, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 56, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2157af39-a2fd-483d-a377-f53731d218a3/file', 'properties': {}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc3d65f-570e-4931-870a-03c6b3167434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:26 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Volume volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 (907853f0-9250-4bf4-b3d7-03d2a10f0916): created successfully Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc3d65f-570e-4931-870a-03c6b3167434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Flow 'volume_create_manager' (c2b12b47-2fbd-4c3d-a81e-8a8ea4c68413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:27 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7f5e8b09-65de-4f9f-8966-75075fd57a75 tempest-VolumeImageDependencyTests-957298909 None] Created volume successfully. Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "cinder-6ad0236e-ecb2-4455-9bfc-150b97bfc241-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-6ad0236e-ecb2-4455-9bfc-150b97bfc241-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "cinder-quobyte-590613b6-4687-413e-8a23-0f6e5932b922" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-quobyte-590613b6-4687-413e-8a23-0f6e5932b922" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "cinder-quobyte-6ad0236e-ecb2-4455-9bfc-150b97bfc241" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-quobyte-6ad0236e-ecb2-4455-9bfc-150b97bfc241" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Deleting offline snapshot 6ad0236e-ecb2-4455-9bfc-150b97bfc241 of volume 590613b6-4687-413e-8a23-0f6e5932b922 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] snapshot_file for this snap is: volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Acquiring lock "cinder-907853f0-9250-4bf4-b3d7-03d2a10f0916-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5616458e-646d-472f-9b6f-56e8ec831bf9]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Lock "cinder-907853f0-9250-4bf4-b3d7-03d2a10f0916-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Acquiring lock "cinder-quobyte-907853f0-9250-4bf4-b3d7-03d2a10f0916" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Lock "cinder-quobyte-907853f0-9250-4bf4-b3d7-03d2a10f0916" acquired by "delete_volume" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e45abab-75b7-4f31-a928-08feb5e5f154]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:27 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 Sep 25 10:56:27 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:27 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 Sep 25 10:56:27 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:28 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241" returned: 0 in 0.474s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-590613b6-4687-413e-8a23-0f6e5932b922(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[647601d3-cb33-49ed-b9e2-4b84411e3837]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:28 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916" returned: 0 in 0.490s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:28 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922 Sep 25 10:56:28 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916 Sep 25 10:56:28 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:28 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:28 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-907853f0-9250-4bf4-b3d7-03d2a10f0916" returned: 0 in 0.293s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Lock "cinder-quobyte-907853f0-9250-4bf4-b3d7-03d2a10f0916" released by "delete_volume" :: held 0.859s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:28 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922" returned: 0 in 0.457s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:28 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 Sep 25 10:56:28 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Created reservations ['0a68ec42-5e9f-4ba2-9daf-5071ec16a9a0', '2f2e77bf-7238-4ece-9774-168b44a1fd34', '1add2814-2e3a-4059-af69-9c230e9fd8f7', 'fafc85d0-66b0-43c5-8c74-3c675c822010'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:28 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:56:28 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:29 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241" returned: 0 in 0.501s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:29 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.355s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:29 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:29 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241 Sep 25 10:56:29 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:29 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Deleted volume successfully. Sep 25 10:56:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-53e2520f-503c-4ad4-ba74-7eceb425997c tempest-VolumeImageDependencyTests-957298909 None] Lock "cinder-907853f0-9250-4bf4-b3d7-03d2a10f0916-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:29 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922.6ad0236e-ecb2-4455-9bfc-150b97bfc241" returned: 0 in 0.379s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-quobyte-6ad0236e-ecb2-4455-9bfc-150b97bfc241" released by "_delete_snapshot" :: held 1.986s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-quobyte-590613b6-4687-413e-8a23-0f6e5932b922" released by "delete_snapshot" :: held 2.016s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:29 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Created reservations ['4b5d6da7-1866-4eb0-a421-60f58ec33133', 'c8998b99-ac65-47d9-bb1f-e75ae669b654', '3f3fbdc6-a2ad-4f4e-83bf-056918f5434e', '195cd5f9-9313-45a0-91e7-819b290c932c'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:29 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Delete snapshot completed successfully. Sep 25 10:56:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-29621b97-9a1c-4066-9d11-f0a907ec9671 tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-6ad0236e-ecb2-4455-9bfc-150b97bfc241-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "cinder-590613b6-4687-413e-8a23-0f6e5932b922-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-590613b6-4687-413e-8a23-0f6e5932b922-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "cinder-quobyte-590613b6-4687-413e-8a23-0f6e5932b922" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-quobyte-590613b6-4687-413e-8a23-0f6e5932b922" acquired by "delete_volume" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:31 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf7152c-6d3a-44cb-ae3f-72ca1e0d7e52]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:31 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922 Sep 25 10:56:31 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:31 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922" returned: 0 in 0.536s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:31 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922 Sep 25 10:56:31 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:32 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-590613b6-4687-413e-8a23-0f6e5932b922" returned: 0 in 0.321s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-quobyte-590613b6-4687-413e-8a23-0f6e5932b922" released by "delete_volume" :: held 0.963s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:32 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Created reservations ['41225582-ae12-496f-b896-bcb55cc9c633', '4cf804db-ed53-41b9-975b-b3c59023b0e7', 'dd4aa416-52ba-468c-ac50-7ab2c499057b', 'c04939cc-9490-4ab9-82f9-eb5e2751b497'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:32 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:56:32 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:32 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.322s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:32 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:32 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Deleted volume successfully. Sep 25 10:56:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a25a9626-4271-43eb-a2b1-243dfebfca3e tempest-VolumesSnapshotListTestJSON-1201721726 None] Lock "cinder-590613b6-4687-413e-8a23-0f6e5932b922-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Flow 'volume_create_manager' (e53ded7c-fc78-47c9-a54a-306042faac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a62bd8-41c4-4456-9553-3048bfb6f0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a62bd8-41c4-4456-9553-3048bfb6f0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc68c6e-eada-4850-a3f8-de9d380b11a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d13b427a7f846789e27c70efb4f07d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:33Z,use_quota=True,user_id='07e5b626fa744ce8bf81f8eeda76d27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75af4db9-5c6f-4467-b34b-18d926d4304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75af4db9-5c6f-4467-b34b-18d926d4304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a521ce1f-e169-45df-a5a8-c0dc24463326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a521ce1f-e169-45df-a5a8-c0dc24463326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cc68c6e-eada-4850-a3f8-de9d380b11a4', 'volume_name': 'volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de1ec5f-d968-4120-a2b2-dbdfedd9b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de1ec5f-d968-4120-a2b2-dbdfedd9b496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2e6213-88d6-41cf-926e-29dbb5d3c4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:33 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Volume 7cc68c6e-eada-4850-a3f8-de9d380b11a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4', 'volume_size': 1} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc68c6e-eada-4850-a3f8-de9d380b11a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d13b427a7f846789e27c70efb4f07d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:33Z,use_quota=True,user_id='07e5b626fa744ce8bf81f8eeda76d27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Creating volume 7cc68c6e-eada-4850-a3f8-de9d380b11a4 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:56:33 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:33 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4 1073741824 Sep 25 10:56:33 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:33 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4 1073741824" returned: 0 in 0.702s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:34 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4 Sep 25 10:56:34 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:34 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4" returned: 0 in 0.331s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:56:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2e6213-88d6-41cf-926e-29dbb5d3c4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2458bb53-2a20-49a0-81cb-c2f7e8c7d944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:34 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Volume volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4 (7cc68c6e-eada-4850-a3f8-de9d380b11a4): created successfully Sep 25 10:56:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2458bb53-2a20-49a0-81cb-c2f7e8c7d944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:34 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Flow 'volume_create_manager' (e53ded7c-fc78-47c9-a54a-306042faac31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:34 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2025e0cf-8fef-459d-a2fa-ae5559e97132 tempest-CinderUnicodeTest-799943843 None] Created volume successfully. Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=218,cinder:SELECT=146,cinder:INSERT=70,cinder:DELETE=13 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Flow 'volume_create_manager' (1de28a99-70ec-41ed-8aa4-5ea97ec96312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77443abe-f7c9-4680-8b03-f75fc383ef07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77443abe-f7c9-4680-8b03-f75fc383ef07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1626847511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde504bc-0a06-4930-86d0-4d4bc48f9f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d13b427a7f846789e27c70efb4f07d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:36Z,use_quota=True,user_id='07e5b626fa744ce8bf81f8eeda76d27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef64c008-bb88-49dc-8fbd-d09b694059c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef64c008-bb88-49dc-8fbd-d09b694059c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b146251-33d5-4414-b427-4d406fac93f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b146251-33d5-4414-b427-4d406fac93f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde504bc-0a06-4930-86d0-4d4bc48f9f48', 'volume_name': 'volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523c9985-42bf-4052-ba83-7b4ec12ed9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523c9985-42bf-4052-ba83-7b4ec12ed9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9ee6eb-f9ef-48ae-b7f1-1b3f13cd5881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:36 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Volume bde504bc-0a06-4930-86d0-4d4bc48f9f48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48', 'volume_size': 1} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1626847511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde504bc-0a06-4930-86d0-4d4bc48f9f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d13b427a7f846789e27c70efb4f07d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:36Z,use_quota=True,user_id='07e5b626fa744ce8bf81f8eeda76d27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Creating volume bde504bc-0a06-4930-86d0-4d4bc48f9f48 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:56:36 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:36 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 1073741824 Sep 25 10:56:36 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Flow 'volume_create_manager' (12cfab6a-af5d-4866-b3c5-1c9aa6abc8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d419c859-21fc-4a46-a223-f8fc03564f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d419c859-21fc-4a46-a223-f8fc03564f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-638699175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9448eaec57a8435a93f8a7400104a057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:36Z,use_quota=True,user_id='202c016f531b4eb3a2d55c585364a07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbc5fc9-2598-489f-b573-a551bcc2058e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbc5fc9-2598-489f-b573-a551bcc2058e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466f3dba-e86b-4937-ba2b-c818b3804b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466f3dba-e86b-4937-ba2b-c818b3804b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3', 'volume_name': 'volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d96aac-d6c5-41d4-b061-2480fe83bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d96aac-d6c5-41d4-b061-2480fe83bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65085df-5df9-4ba8-939d-821ac7c9f22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:36 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Volume c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3', 'volume_size': 1} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:36 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 1073741824" returned: 0 in 0.577s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:36 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 Sep 25 10:56:36 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:37 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48" returned: 0 in 0.308s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.806s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-638699175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9448eaec57a8435a93f8a7400104a057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:36Z,use_quota=True,user_id='202c016f531b4eb3a2d55c585364a07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Creating volume c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:56:37 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9ee6eb-f9ef-48ae-b7f1-1b3f13cd5881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaac7908-0a34-4177-9ad9-1470ff270da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:37 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 1073741824 Sep 25 10:56:37 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:37 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Volume volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 (bde504bc-0a06-4930-86d0-4d4bc48f9f48): created successfully Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaac7908-0a34-4177-9ad9-1470ff270da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Flow 'volume_create_manager' (1de28a99-70ec-41ed-8aa4-5ea97ec96312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:37 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bd08b05c-768a-4fea-8817-72c4d5002312 tempest-CinderUnicodeTest-799943843 None] Created volume successfully. Sep 25 10:56:37 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 1073741824" returned: 0 in 0.558s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:37 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 Sep 25 10:56:37 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:38 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3" returned: 0 in 0.288s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:56:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65085df-5df9-4ba8-939d-821ac7c9f22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79dcac54-1204-4984-b8f5-3307dc7b7563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:38 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Volume volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 (c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3): created successfully Sep 25 10:56:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79dcac54-1204-4984-b8f5-3307dc7b7563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:38 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Flow 'volume_create_manager' (12cfab6a-af5d-4866-b3c5-1c9aa6abc8f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:38 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4cb3b5b9-9f8c-4fe0-9ef1-2ecdf85a1acb tempest-VolumesSnapshotTestJSON-1635954554 None] Created volume successfully. Sep 25 10:56:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] Creating offline snapshot 237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 of volume bde504bc-0a06-4930-86d0-4d4bc48f9f48 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:56:38 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[728b1bff-11bc-4361-876d-2c67179a7208]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:38 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 Sep 25 10:56:38 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:38 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48" returned: 0 in 0.405s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:38 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 1G Sep 25 10:56:38 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:39 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 1G" returned: 0 in 0.504s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:39 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 Sep 25 10:56:39 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:39 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4" returned: 0 in 0.434s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:39 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 is being set with open permissions: ugo+rw Sep 25 10:56:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:39 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 Sep 25 10:56:39 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:40 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4" returned: 0 in 0.303s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:40 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.info Sep 25 10:56:40 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:40 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.info" returned: 0 in 0.304s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:40 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.info is being set with open permissions: ugo+rw Sep 25 10:56:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:40 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.info Sep 25 10:56:40 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:40 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.info" returned: 0 in 0.316s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.718s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] Creating offline snapshot 7ad478be-d462-421a-9927-8bcec531e32f of volume c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:56:40 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-32145bca-5219-448a-bd53-22de9ddbbb96 tempest-CinderUnicodeTest-799943843 None] Create snapshot completed successfully Sep 25 10:56:40 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb32d0ed-4aee-4d0d-b391-37619375235b]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:40 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 Sep 25 10:56:40 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:41 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3" returned: 0 in 0.489s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:41 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f 1G Sep 25 10:56:41 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Acquiring lock "cinder-237f19c6-1eb1-4a8a-b4bc-2002fec9cef4-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Lock "cinder-237f19c6-1eb1-4a8a-b4bc-2002fec9cef4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Acquiring lock "cinder-quobyte-bde504bc-0a06-4930-86d0-4d4bc48f9f48" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Lock "cinder-quobyte-bde504bc-0a06-4930-86d0-4d4bc48f9f48" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Acquiring lock "cinder-quobyte-237f19c6-1eb1-4a8a-b4bc-2002fec9cef4" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Lock "cinder-quobyte-237f19c6-1eb1-4a8a-b4bc-2002fec9cef4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Deleting offline snapshot 237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 of volume bde504bc-0a06-4930-86d0-4d4bc48f9f48 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:56:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] snapshot_file for this snap is: volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:56:41 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae6c0f9-02bf-4310-8ee1-6d91761fb7c8]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:41 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f 1G" returned: 0 in 0.539s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:41 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f Sep 25 10:56:41 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:41 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 Sep 25 10:56:41 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:42 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f" returned: 0 in 0.384s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:42 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f is being set with open permissions: ugo+rw Sep 25 10:56:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:42 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f Sep 25 10:56:42 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:42 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4" returned: 0 in 0.587s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:42 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:56:42 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f877c31a-6d10-4cc1-8ebf-d20d20602491]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:42 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 Sep 25 10:56:42 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:42 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f" returned: 0 in 0.487s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:42 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.info Sep 25 10:56:42 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:43 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:43 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.info" returned: 0 in 0.441s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:43 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.info is being set with open permissions: ugo+rw Sep 25 10:56:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48" returned: 0 in 0.779s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:43 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.info Sep 25 10:56:43 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:43 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 Sep 25 10:56:43 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:43 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.info" returned: 0 in 0.391s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.901s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:43 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4" returned: 0 in 0.524s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:43 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4 Sep 25 10:56:43 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:43 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b418cf47-d413-4978-a3b7-e8eebc1fabb2 tempest-VolumesSnapshotTestJSON-1635954554 None] Create snapshot completed successfully Sep 25 10:56:44 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48.237f19c6-1eb1-4a8a-b4bc-2002fec9cef4" returned: 0 in 0.345s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Lock "cinder-quobyte-237f19c6-1eb1-4a8a-b4bc-2002fec9cef4" released by "_delete_snapshot" :: held 2.468s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Lock "cinder-quobyte-bde504bc-0a06-4930-86d0-4d4bc48f9f48" released by "delete_snapshot" :: held 2.500s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Created reservations ['462efca9-52ba-4ab2-802c-bfac0544c6eb', '66f94f42-7684-49a0-a542-4071bd365e01', 'd4e2c5f2-fbc0-4b75-a00a-ddb1022122c5', 'd9fcd6e5-d511-4fd6-8e3f-c26fe24c7fe9'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:44 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Delete snapshot completed successfully. Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40d5802e-8e9a-46b4-a49b-cb3d92692e60 tempest-CinderUnicodeTest-799943843 None] Lock "cinder-237f19c6-1eb1-4a8a-b4bc-2002fec9cef4-delete_snapshot" released by "delete_snapshot" :: held 2.714s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-7ad478be-d462-421a-9927-8bcec531e32f-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-7ad478be-d462-421a-9927-8bcec531e32f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-7ad478be-d462-421a-9927-8bcec531e32f" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-7ad478be-d462-421a-9927-8bcec531e32f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Deleting offline snapshot 7ad478be-d462-421a-9927-8bcec531e32f of volume c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] snapshot_file for this snap is: volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bf4732-e4c3-42dd-be6d-02984192e9b5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:44 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f Sep 25 10:56:44 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Acquiring lock "cinder-bde504bc-0a06-4930-86d0-4d4bc48f9f48-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Lock "cinder-bde504bc-0a06-4930-86d0-4d4bc48f9f48-delete_volume" acquired by "delete_volume" :: waited 0.154s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Acquiring lock "cinder-quobyte-bde504bc-0a06-4930-86d0-4d4bc48f9f48" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Lock "cinder-quobyte-bde504bc-0a06-4930-86d0-4d4bc48f9f48" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:45 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[31db8c51-b289-4883-b9c4-af6dd9af2f58]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:45 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f" returned: 0 in 0.691s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:56:45 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[13687963-7d0a-418a-a0fe-ac9123464b97]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:45 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 Sep 25 10:56:45 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:45 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 Sep 25 10:56:45 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:45 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48" returned: 0 in 0.533s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:45 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48 Sep 25 10:56:45 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:46 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3" returned: 0 in 0.598s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:46 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f Sep 25 10:56:46 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:46 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-bde504bc-0a06-4930-86d0-4d4bc48f9f48" returned: 0 in 0.462s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Lock "cinder-quobyte-bde504bc-0a06-4930-86d0-4d4bc48f9f48" released by "delete_volume" :: held 1.093s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Created reservations ['98b493e9-adf5-457f-8d9b-2d445c02be3a', '16c454c4-a05e-4b7d-8ddd-136fc0ef1ef3', 'dbcbdca6-d19c-494c-bf66-1cb6c65a30c8', '5646c362-aee4-4e9b-9a85-3e78b45d35b5'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:46 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f" returned: 0 in 0.526s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:46 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:56:46 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:46 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f Sep 25 10:56:46 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:46 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.342s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:46 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Deleted volume successfully. Sep 25 10:56:46 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3.7ad478be-d462-421a-9927-8bcec531e32f" returned: 0 in 0.351s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-df4914c9-fe69-4b44-a0c6-358200ea8bf2 tempest-CinderUnicodeTest-799943843 None] Lock "cinder-bde504bc-0a06-4930-86d0-4d4bc48f9f48-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-7ad478be-d462-421a-9927-8bcec531e32f" released by "_delete_snapshot" :: held 2.344s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3" released by "delete_snapshot" :: held 2.369s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:47 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Created reservations ['d9e0a852-dfe0-487c-8252-3185f1fe772d', 'cba53a01-c1d8-4b08-a05f-05310eb5b50a', 'b74fb89d-14f1-4506-92c4-a2364ef99349', 'a48b3c29-df30-4bf0-ade7-52c1b735fb98'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:47 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Delete snapshot completed successfully. Sep 25 10:56:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-676a1c59-8422-4b5b-9d99-3de0ccee2b2f tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-7ad478be-d462-421a-9927-8bcec531e32f-delete_snapshot" released by "delete_snapshot" :: held 2.581s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Acquiring lock "cinder-7cc68c6e-eada-4850-a3f8-de9d380b11a4-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Lock "cinder-7cc68c6e-eada-4850-a3f8-de9d380b11a4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Acquiring lock "cinder-quobyte-7cc68c6e-eada-4850-a3f8-de9d380b11a4" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Lock "cinder-quobyte-7cc68c6e-eada-4850-a3f8-de9d380b11a4" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:47 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[845f0020-0315-4e01-82b3-2cf9db13e5ab]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:47 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4 Sep 25 10:56:47 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:48 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4" returned: 0 in 0.586s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:48 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4 Sep 25 10:56:48 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:48 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7cc68c6e-eada-4850-a3f8-de9d380b11a4" returned: 0 in 0.550s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Lock "cinder-quobyte-7cc68c6e-eada-4850-a3f8-de9d380b11a4" released by "delete_volume" :: held 1.219s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Flow 'volume_create_manager' (bb0dacee-2ca7-4c08-bce2-7ae4795c7c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f40aded-9ff4-47d4-8f75-04350d8347e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Created reservations ['c44d8b55-e7ef-4476-b480-e3ec71392415', '40de0da9-522e-4e37-9bdf-08dd84778e2c', 'af9d693b-a850-4da7-955d-8f5a9a0f4bf0', '865d7a8f-df75-4ba1-9186-08aba9b677f6'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f40aded-9ff4-47d4-8f75-04350d8347e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2072045779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a815e07-ae58-4e36-8b20-b97f6c5043db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9448eaec57a8435a93f8a7400104a057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:49Z,use_quota=True,user_id='202c016f531b4eb3a2d55c585364a07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea0e467-b1a4-457b-8dc2-7feae25f0ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea0e467-b1a4-457b-8dc2-7feae25f0ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f58ae27-a134-4960-b44f-a3b10f1f92cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f58ae27-a134-4960-b44f-a3b10f1f92cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a815e07-ae58-4e36-8b20-b97f6c5043db', 'volume_name': 'volume-8a815e07-ae58-4e36-8b20-b97f6c5043db', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179b0ade-4610-41af-9035-5cb8022dc301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179b0ade-4610-41af-9035-5cb8022dc301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c516810-87bc-4c2b-95ec-709d90d8706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:48 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Volume 8a815e07-ae58-4e36-8b20-b97f6c5043db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a815e07-ae58-4e36-8b20-b97f6c5043db', 'volume_size': 1} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2072045779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a815e07-ae58-4e36-8b20-b97f6c5043db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9448eaec57a8435a93f8a7400104a057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:49Z,use_quota=True,user_id='202c016f531b4eb3a2d55c585364a07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Creating volume 8a815e07-ae58-4e36-8b20-b97f6c5043db {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:56:48 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:56:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:48 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db 1073741824 Sep 25 10:56:48 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:49 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:56:49 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:49 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.291s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:49 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Deleted volume successfully. Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-274d838a-aaa7-48e7-8c10-ed65036dc217 tempest-CinderUnicodeTest-799943843 None] Lock "cinder-7cc68c6e-eada-4850-a3f8-de9d380b11a4-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:49 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db 1073741824" returned: 0 in 0.549s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:49 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db Sep 25 10:56:49 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:49 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db" returned: 0 in 0.414s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c516810-87bc-4c2b-95ec-709d90d8706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a815e07-ae58-4e36-8b20-b97f6c5043db', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ad57e7-0c35-4546-ab60-2a3b409f9a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:50 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Volume volume-8a815e07-ae58-4e36-8b20-b97f6c5043db (8a815e07-ae58-4e36-8b20-b97f6c5043db): created successfully Sep 25 10:56:50 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ad57e7-0c35-4546-ab60-2a3b409f9a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:50 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Flow 'volume_create_manager' (bb0dacee-2ca7-4c08-bce2-7ae4795c7c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:50 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7fe3e880-f3e5-4444-9a1a-5ae7a50e95e8 tempest-VolumesSnapshotTestJSON-1635954554 None] Created volume successfully. Sep 25 10:56:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] Creating offline snapshot 59de0e75-b7a6-4661-b670-f0ed1a96fdbc of volume 8a815e07-ae58-4e36-8b20-b97f6c5043db {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:56:51 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2899fdec-9a03-4d8c-9611-b567113d4d20]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:51 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db Sep 25 10:56:51 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:51 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db" returned: 0 in 0.555s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:51 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc 1G Sep 25 10:56:51 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:52 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc 1G" returned: 0 in 0.515s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a815e07-ae58-4e36-8b20-b97f6c5043db -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:52 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a815e07-ae58-4e36-8b20-b97f6c5043db -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc Sep 25 10:56:52 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:52 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a815e07-ae58-4e36-8b20-b97f6c5043db -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc" returned: 0 in 0.356s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:52 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc is being set with open permissions: ugo+rw Sep 25 10:56:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:52 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc Sep 25 10:56:52 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:52 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc" returned: 0 in 0.290s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:52 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.info Sep 25 10:56:52 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:53 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.info" returned: 0 in 0.313s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:53 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.info is being set with open permissions: ugo+rw Sep 25 10:56:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:53 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.info Sep 25 10:56:53 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:53 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.info" returned: 0 in 0.277s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.458s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:53 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2cede844-3523-4c2f-bf2a-87aa59d5444c tempest-VolumesSnapshotTestJSON-1635954554 None] Create snapshot completed successfully Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Flow 'volume_create_manager' (2aa8ee85-521b-481d-bce5-3cf75efabeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52357ab7-e9ff-4a65-a0d2-1a6454045d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52357ab7-e9ff-4a65-a0d2-1a6454045d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1084446045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9448eaec57a8435a93f8a7400104a057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=59de0e75-b7a6-4661-b670-f0ed1a96fdbc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:55Z,use_quota=True,user_id='202c016f531b4eb3a2d55c585364a07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4debd14e-5f28-4892-a6eb-82f52d8b1998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4debd14e-5f28-4892-a6eb-82f52d8b1998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582da025-65ec-49f4-9734-db77b5a4c869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582da025-65ec-49f4-9734-db77b5a4c869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2', 'volume_name': 'volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2', 'volume_size': 2, 'snapshot_id': '59de0e75-b7a6-4661-b670-f0ed1a96fdbc'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505fd1f0-637d-482c-83c7-5cac1e860683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505fd1f0-637d-482c-83c7-5cac1e860683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97518e4b-d33a-4049-ac86-93e4dd8036d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:55 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Volume e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2', 'volume_size': 2, 'snapshot_id': '59de0e75-b7a6-4661-b670-f0ed1a96fdbc'} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-59de0e75-b7a6-4661-b670-f0ed1a96fdbc-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2" by "_create_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-59de0e75-b7a6-4661-b670-f0ed1a96fdbc-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Creating volume e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2 from snapshot 59de0e75-b7a6-4661-b670-f0ed1a96fdbc {{(pid=86874) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2" by "_copy_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] snapshot: 59de0e75-b7a6-4661-b670-f0ed1a96fdbc, volume: e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2, {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[da54feb7-7751-44fc-b085-cc4c8b7f03d8]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:55 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc Sep 25 10:56:55 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:56 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc" returned: 0 in 0.607s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a815e07-ae58-4e36-8b20-b97f6c5043db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:56:56 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f504155-0060-4ebd-9b9c-3753ba4fff6f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:56 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db Sep 25 10:56:56 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:56 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db" returned: 0 in 0.521s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] will copy from snapshot at /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:56:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Creating direct copy from snapshot {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:56:56 devstack cinder-volume[86874]: DEBUG cinder.utils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Path /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2 not found in is_blk_device check {{(pid=86874) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 10:56:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:56 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2 Sep 25 10:56:56 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:05 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=121,cinder:UPDATE=121,cinder:INSERT=35,cinder:DELETE=11 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:57:05 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=45,cinder:UPDATE=42,cinder:DELETE=6,cinder:INSERT=10 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:57:05 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2" returned: 0 in 8.943s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:05 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db, size 1024.00 MB, duration 8.94 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:57:05 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Converted 1024.00 MB image at 114.49 MB/s Sep 25 10:57:05 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2 is being set with open permissions: ugo+rw Sep 25 10:57:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:05 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2 Sep 25 10:57:05 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:05 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2" returned: 0 in 0.275s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2" released by "_copy_volume_from_snapshot" :: held 10.475s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-59de0e75-b7a6-4661-b670-f0ed1a96fdbc-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2" released by "_create_volume_from_snapshot" :: held 10.549s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.574s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97518e4b-d33a-4049-ac86-93e4dd8036d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2', 'volume_size': 2, 'snapshot_id': '59de0e75-b7a6-4661-b670-f0ed1a96fdbc'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cbecad1-eff5-4306-8195-6a35578e3cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:06 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Volume volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2 (e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2): created successfully Sep 25 10:57:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cbecad1-eff5-4306-8195-6a35578e3cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Flow 'volume_create_manager' (2aa8ee85-521b-481d-bce5-3cf75efabeca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:57:06 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-1a2e8a86-58d5-4629-bf99-95091d6b6464 tempest-VolumesSnapshotTestJSON-1635954554 None] Created volume successfully. Sep 25 10:57:06 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:06 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:06 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:06 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2" acquired by "delete_volume" :: waited 0.015s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:06 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfa2df2-10d0-44a8-a01b-4bd94ea95a43]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:06 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2 Sep 25 10:57:06 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:07 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2" returned: 0 in 0.404s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:07 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2 Sep 25 10:57:07 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:07 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2" returned: 0 in 0.285s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2" released by "delete_volume" :: held 0.739s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Created reservations ['c457dd49-e771-4a2f-9796-5495176825b9', '90356560-ff5a-4791-8f83-ec78e3d367f5', '707620d9-aee3-425b-a5cb-c2447b056b7c', 'd74eb17c-f56e-4226-af73-e6a89403fe16'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:07 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:57:07 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-59de0e75-b7a6-4661-b670-f0ed1a96fdbc-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-59de0e75-b7a6-4661-b670-f0ed1a96fdbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-8a815e07-ae58-4e36-8b20-b97f6c5043db" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-8a815e07-ae58-4e36-8b20-b97f6c5043db" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-59de0e75-b7a6-4661-b670-f0ed1a96fdbc" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-59de0e75-b7a6-4661-b670-f0ed1a96fdbc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Deleting offline snapshot 59de0e75-b7a6-4661-b670-f0ed1a96fdbc of volume 8a815e07-ae58-4e36-8b20-b97f6c5043db {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:57:07 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] snapshot_file for this snap is: volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:57:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.292s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:08 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:57:08 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Deleted volume successfully. Sep 25 10:57:08 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be3fd2a-8228-4c13-bf6e-cb8f1ed90f56]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4fb6cc48-0df6-46f8-b9bf-c9894e5fc765 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-e16bb1e2-efa4-4754-ac5c-454c6a7ed3e2-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:08 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc Sep 25 10:57:08 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:08 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc" returned: 0 in 0.393s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a815e07-ae58-4e36-8b20-b97f6c5043db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:57:08 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9203d87-f029-4ef7-aa50-2d3ef9b0921b]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:08 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db Sep 25 10:57:08 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:09 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db" returned: 0 in 0.583s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:09 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc Sep 25 10:57:09 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:09 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc" returned: 0 in 0.395s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:09 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc Sep 25 10:57:09 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:09 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db.59de0e75-b7a6-4661-b670-f0ed1a96fdbc" returned: 0 in 0.287s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-59de0e75-b7a6-4661-b670-f0ed1a96fdbc" released by "_delete_snapshot" :: held 1.793s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-8a815e07-ae58-4e36-8b20-b97f6c5043db" released by "delete_snapshot" :: held 1.822s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:09 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Created reservations ['8160fca8-1c2e-49d6-9f59-a5e00294c8f5', '39f731c9-dc09-4352-afa8-b99455298f55', 'c9229aca-9996-4d46-bc0f-3ee66cacb333', 'd7b0adb6-2e44-461b-a02f-e62da683fffb'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:57:09 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Delete snapshot completed successfully. Sep 25 10:57:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4b48c09e-9178-42a2-92ab-161628094364 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-59de0e75-b7a6-4661-b670-f0ed1a96fdbc-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-8a815e07-ae58-4e36-8b20-b97f6c5043db-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-8a815e07-ae58-4e36-8b20-b97f6c5043db-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-8a815e07-ae58-4e36-8b20-b97f6c5043db" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-8a815e07-ae58-4e36-8b20-b97f6c5043db" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:10 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1642614b-489f-4f03-a7e2-08de018e07bc]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:10 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db Sep 25 10:57:10 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:10 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db" returned: 0 in 0.541s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:10 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db Sep 25 10:57:10 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:11 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8a815e07-ae58-4e36-8b20-b97f6c5043db" returned: 0 in 0.340s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-8a815e07-ae58-4e36-8b20-b97f6c5043db" released by "delete_volume" :: held 0.955s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:11 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Created reservations ['3757b411-f21e-4392-b5b8-4393809baf32', '66f8d85f-869b-437d-932c-fd0fc90f9b57', '7ee93cc8-2ac3-46b8-b17d-0d2f7c47775f', '4a40e76c-16af-49d7-84f1-e3049562bc24'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:57:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:11 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:57:11 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:57:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:11 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:57:11 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:11 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.437s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:11 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:57:11 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Deleted volume successfully. Sep 25 10:57:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ae007dd7-4df2-40ae-9ca5-11a6da02bcb1 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-8a815e07-ae58-4e36-8b20-b97f6c5043db-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Flow 'volume_create_manager' (69e23bbc-66c6-4c3e-8020-0d998fce5411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289d41a2-cb8d-47e8-ab71-1c05bbde34bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289d41a2-cb8d-47e8-ab71-1c05bbde34bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-997860872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76527764-63d8-4275-9b0c-546ad55bdfae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9448eaec57a8435a93f8a7400104a057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:57:13Z,use_quota=True,user_id='202c016f531b4eb3a2d55c585364a07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19f3eaf-11de-4e9a-b815-5cd31e849cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19f3eaf-11de-4e9a-b815-5cd31e849cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a812262-e27f-4e52-853e-93a8aa200099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a812262-e27f-4e52-853e-93a8aa200099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76527764-63d8-4275-9b0c-546ad55bdfae', 'volume_name': 'volume-76527764-63d8-4275-9b0c-546ad55bdfae', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33466e91-4e5a-4c6e-9b92-498e6c53274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33466e91-4e5a-4c6e-9b92-498e6c53274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc5e600-ea4c-4bc7-90a6-e2d377e9407e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:13 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Volume 76527764-63d8-4275-9b0c-546ad55bdfae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76527764-63d8-4275-9b0c-546ad55bdfae', 'volume_size': 1} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-997860872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76527764-63d8-4275-9b0c-546ad55bdfae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9448eaec57a8435a93f8a7400104a057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:57:13Z,use_quota=True,user_id='202c016f531b4eb3a2d55c585364a07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Creating volume 76527764-63d8-4275-9b0c-546ad55bdfae {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:57:13 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:13 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae 1073741824 Sep 25 10:57:13 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:13 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae 1073741824" returned: 0 in 0.569s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:13 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae Sep 25 10:57:13 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:14 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae" returned: 0 in 0.454s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:57:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc5e600-ea4c-4bc7-90a6-e2d377e9407e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76527764-63d8-4275-9b0c-546ad55bdfae', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6976621-518f-4a47-a3ab-934905f80afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:14 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Volume volume-76527764-63d8-4275-9b0c-546ad55bdfae (76527764-63d8-4275-9b0c-546ad55bdfae): created successfully Sep 25 10:57:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6976621-518f-4a47-a3ab-934905f80afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Flow 'volume_create_manager' (69e23bbc-66c6-4c3e-8020-0d998fce5411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:57:14 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-dfca370a-e141-4efa-bb52-4953ab2307a6 tempest-VolumesSnapshotTestJSON-1635954554 None] Created volume successfully. Sep 25 10:57:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] Creating offline snapshot e7a79927-6ced-42ce-a39a-946158d60ce9 of volume 76527764-63d8-4275-9b0c-546ad55bdfae {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:57:15 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b487b7-f62e-4e0b-843f-18b739b1c43a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:15 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae Sep 25 10:57:15 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:16 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae" returned: 0 in 0.536s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:16 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 1G Sep 25 10:57:16 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:16 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 1G" returned: 0 in 0.564s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76527764-63d8-4275-9b0c-546ad55bdfae -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:16 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76527764-63d8-4275-9b0c-546ad55bdfae -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 Sep 25 10:57:16 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:17 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76527764-63d8-4275-9b0c-546ad55bdfae -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9" returned: 0 in 0.460s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:17 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 is being set with open permissions: ugo+rw Sep 25 10:57:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:17 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 Sep 25 10:57:17 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:17 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9" returned: 0 in 0.418s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:17 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.info Sep 25 10:57:17 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:18 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.info" returned: 0 in 0.350s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:18 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.info is being set with open permissions: ugo+rw Sep 25 10:57:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:18 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.info Sep 25 10:57:18 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:18 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.info" returned: 0 in 0.332s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.801s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b5a3e298-4d39-4a41-af14-eeb8b005df72 tempest-VolumesSnapshotTestJSON-1635954554 None] Create snapshot completed successfully Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Flow 'volume_create_manager' (67d959bc-e59c-4f54-8346-15d8e54b5708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ec4805-ef43-419a-8a36-36c5161ee639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ec4805-ef43-419a-8a36-36c5161ee639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1813681916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308f3f23-737a-47bd-a072-caa38857782c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9448eaec57a8435a93f8a7400104a057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e7a79927-6ced-42ce-a39a-946158d60ce9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:57:20Z,use_quota=True,user_id='202c016f531b4eb3a2d55c585364a07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09498bc-f210-4fbf-92c5-7a898faf3bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09498bc-f210-4fbf-92c5-7a898faf3bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fa662d-acf0-4acb-89db-66f965d1df5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fa662d-acf0-4acb-89db-66f965d1df5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '308f3f23-737a-47bd-a072-caa38857782c', 'volume_name': 'volume-308f3f23-737a-47bd-a072-caa38857782c', 'volume_size': 1, 'snapshot_id': 'e7a79927-6ced-42ce-a39a-946158d60ce9'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d7079e-a59b-4919-9598-4951b76d57d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d7079e-a59b-4919-9598-4951b76d57d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7107f33b-e506-47da-ae9d-daa2020208a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:19 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Volume 308f3f23-737a-47bd-a072-caa38857782c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-308f3f23-737a-47bd-a072-caa38857782c', 'volume_size': 1, 'snapshot_id': 'e7a79927-6ced-42ce-a39a-946158d60ce9'} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-e7a79927-6ced-42ce-a39a-946158d60ce9-308f3f23-737a-47bd-a072-caa38857782c" by "_create_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-e7a79927-6ced-42ce-a39a-946158d60ce9-308f3f23-737a-47bd-a072-caa38857782c" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Creating volume 308f3f23-737a-47bd-a072-caa38857782c from snapshot e7a79927-6ced-42ce-a39a-946158d60ce9 {{(pid=86874) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:57:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-308f3f23-737a-47bd-a072-caa38857782c" by "_copy_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-308f3f23-737a-47bd-a072-caa38857782c" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] snapshot: e7a79927-6ced-42ce-a39a-946158d60ce9, volume: 308f3f23-737a-47bd-a072-caa38857782c, {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:57:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:57:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:57:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:20 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5195298-4392-4fa3-9c77-7cb4772b02ca]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:20 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 Sep 25 10:57:20 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:20 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9" returned: 0 in 0.460s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76527764-63d8-4275-9b0c-546ad55bdfae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:57:20 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8742bf-89fc-4d3e-ab2c-71c97707e699]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:20 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae Sep 25 10:57:20 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:21 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae" returned: 0 in 0.441s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] will copy from snapshot at /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:57:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Creating direct copy from snapshot {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:57:21 devstack cinder-volume[86874]: DEBUG cinder.utils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Path /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c not found in is_blk_device check {{(pid=86874) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 10:57:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:21 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c Sep 25 10:57:21 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:57:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:57:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:57:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:26 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:57:26 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:26 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.590s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:57:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:57:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:57:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:57:28 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c" returned: 0 in 7.595s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:28 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae, size 1024.00 MB, duration 7.60 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:57:28 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Converted 1024.00 MB image at 134.82 MB/s Sep 25 10:57:28 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c is being set with open permissions: ugo+rw Sep 25 10:57:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:28 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c Sep 25 10:57:28 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:28 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c" returned: 0 in 0.271s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-308f3f23-737a-47bd-a072-caa38857782c" released by "_copy_volume_from_snapshot" :: held 8.888s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-e7a79927-6ced-42ce-a39a-946158d60ce9-308f3f23-737a-47bd-a072-caa38857782c" released by "_create_volume_from_snapshot" :: held 8.983s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7107f33b-e506-47da-ae9d-daa2020208a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308f3f23-737a-47bd-a072-caa38857782c', 'volume_size': 1, 'snapshot_id': 'e7a79927-6ced-42ce-a39a-946158d60ce9'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b4e2b5-441c-4d4f-bc01-5dba465a9ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:29 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Volume volume-308f3f23-737a-47bd-a072-caa38857782c (308f3f23-737a-47bd-a072-caa38857782c): created successfully Sep 25 10:57:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b4e2b5-441c-4d4f-bc01-5dba465a9ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Flow 'volume_create_manager' (67d959bc-e59c-4f54-8346-15d8e54b5708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:57:29 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-3dac706e-98ff-4376-8fde-1e26e1502124 tempest-VolumesSnapshotTestJSON-1635954554 None] Created volume successfully. Sep 25 10:57:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-308f3f23-737a-47bd-a072-caa38857782c-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-308f3f23-737a-47bd-a072-caa38857782c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-308f3f23-737a-47bd-a072-caa38857782c" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-308f3f23-737a-47bd-a072-caa38857782c" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:29 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f9a473-c1bc-4483-aa56-f401a948adb1]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:30 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c Sep 25 10:57:30 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:30 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c" returned: 0 in 0.457s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:30 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c Sep 25 10:57:30 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:30 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-308f3f23-737a-47bd-a072-caa38857782c" returned: 0 in 0.292s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:30 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-308f3f23-737a-47bd-a072-caa38857782c" released by "delete_volume" :: held 0.802s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:30 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Created reservations ['b6c4f807-683d-4b99-9944-6898494be564', '5c1c7cf6-5a3d-490f-b47c-ecf5f4c76d40', '59c70c34-2325-4a6b-a69f-2a20adaa984a', '8e9c0dd5-ab07-4df9-a918-f20abfa49587'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:57:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:57:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:57:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:30 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:57:30 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-e7a79927-6ced-42ce-a39a-946158d60ce9-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-e7a79927-6ced-42ce-a39a-946158d60ce9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-76527764-63d8-4275-9b0c-546ad55bdfae" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-76527764-63d8-4275-9b0c-546ad55bdfae" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-e7a79927-6ced-42ce-a39a-946158d60ce9" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-e7a79927-6ced-42ce-a39a-946158d60ce9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Deleting offline snapshot e7a79927-6ced-42ce-a39a-946158d60ce9 of volume 76527764-63d8-4275-9b0c-546ad55bdfae {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:57:31 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] snapshot_file for this snap is: volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.329s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:57:31 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Deleted volume successfully. Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54e2133-7bc6-4bf4-810e-2e14f89d1409]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2111eab7-1b3c-4013-b0b6-ed2e97e24fd8 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-308f3f23-737a-47bd-a072-caa38857782c-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:31 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 Sep 25 10:57:31 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:31 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9" returned: 0 in 0.437s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76527764-63d8-4275-9b0c-546ad55bdfae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b4a2a6-b65d-41da-b98d-7f7d84c73c70]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:31 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae Sep 25 10:57:31 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:32 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae" returned: 0 in 0.590s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:32 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 Sep 25 10:57:32 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:32 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9" returned: 0 in 0.430s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:32 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9 Sep 25 10:57:32 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:33 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae.e7a79927-6ced-42ce-a39a-946158d60ce9" returned: 0 in 0.339s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-e7a79927-6ced-42ce-a39a-946158d60ce9" released by "_delete_snapshot" :: held 1.937s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-76527764-63d8-4275-9b0c-546ad55bdfae" released by "delete_snapshot" :: held 1.962s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:33 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Created reservations ['f1363c4e-f95f-4661-8b25-1b6393641405', '31f92d35-c0af-4983-96d0-72beb90ab11e', 'ab0bb2b0-f4b6-4d1a-8efd-c2c4700e73ce', '649f7301-5d23-42d0-8cd9-dd2276efe7f4'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:57:33 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Delete snapshot completed successfully. Sep 25 10:57:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c79b2633-38a3-4f9a-a082-11f73863afd5 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-e7a79927-6ced-42ce-a39a-946158d60ce9-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-76527764-63d8-4275-9b0c-546ad55bdfae-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-76527764-63d8-4275-9b0c-546ad55bdfae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-76527764-63d8-4275-9b0c-546ad55bdfae" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-76527764-63d8-4275-9b0c-546ad55bdfae" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:34 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c7e7ee-96f6-4be6-80ac-f83e5779dd03]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:34 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae Sep 25 10:57:34 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:34 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae" returned: 0 in 0.436s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:34 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae Sep 25 10:57:34 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:35 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-76527764-63d8-4275-9b0c-546ad55bdfae" returned: 0 in 0.290s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-76527764-63d8-4275-9b0c-546ad55bdfae" released by "delete_volume" :: held 0.801s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Created reservations ['079e74d1-27fd-4b4e-b9f9-9898ac9f9c8f', '2f281b7f-0600-46eb-9b9a-a0b2d5fc779c', 'cb52fcca-038e-464e-9bce-209008df8d4d', '77afbdf1-3f4b-4e47-8836-d29733124737'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:35 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:57:35 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "cinder-quobyte-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:35 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.359s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3" acquired by "delete_volume" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:35 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Deleted volume successfully. Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cc313750-e801-483c-8009-4173caa90805 tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-76527764-63d8-4275-9b0c-546ad55bdfae-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[578cbfa6-36bc-42b2-bebe-6f12232419bb]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:35 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 Sep 25 10:57:35 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:36 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3" returned: 0 in 0.462s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:36 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3 Sep 25 10:57:36 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:36 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3" returned: 0 in 0.372s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-quobyte-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3" released by "delete_volume" :: held 0.926s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:36 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Created reservations ['219eba5f-6919-4933-9fb6-288d6568278d', 'f54cf552-a718-404c-a141-e10a5b853c6d', '1acdadde-0024-4ec5-ada9-9d146103aaf8', 'e2676a29-d929-4820-b0c7-07681b89f4b6'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:57:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:57:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:57:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:36 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:57:36 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:37 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.289s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:37 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:57:37 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Deleted volume successfully. Sep 25 10:57:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-582d5059-508a-4f70-b715-3f6d238a801d tempest-VolumesSnapshotTestJSON-1635954554 None] Lock "cinder-c4d7eedc-0c6f-4489-b6b8-faf374bf2aa3-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Flow 'volume_create_manager' (9c7a402b-f986-45c9-ab23-7d26b0061d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739c3697-1d38-4ad4-b6c7-8f2f6e201008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739c3697-1d38-4ad4-b6c7-8f2f6e201008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1975394679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f55eed1-3364-4db3-81da-99284e462cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef4da05b83f46d2ab784949807040df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:57:40Z,use_quota=True,user_id='87e10a85073d4b6193e82597bb8248ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16599919-968b-42d1-84ed-a3924ab4440b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16599919-968b-42d1-84ed-a3924ab4440b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4c908f-b090-4ce7-b81d-2a7f5cbeb994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4c908f-b090-4ce7-b81d-2a7f5cbeb994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f55eed1-3364-4db3-81da-99284e462cda', 'volume_name': 'volume-1f55eed1-3364-4db3-81da-99284e462cda', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75946507-223e-4e1c-8ff6-57d219ed26c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75946507-223e-4e1c-8ff6-57d219ed26c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3736bd6-d186-4fea-81bd-69a2bbfee1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:40 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Volume 1f55eed1-3364-4db3-81da-99284e462cda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f55eed1-3364-4db3-81da-99284e462cda', 'volume_size': 1} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1975394679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f55eed1-3364-4db3-81da-99284e462cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef4da05b83f46d2ab784949807040df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:57:40Z,use_quota=True,user_id='87e10a85073d4b6193e82597bb8248ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Creating volume 1f55eed1-3364-4db3-81da-99284e462cda {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:57:40 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f55eed1-3364-4db3-81da-99284e462cda 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:40 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f55eed1-3364-4db3-81da-99284e462cda 1073741824 Sep 25 10:57:40 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:40 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f55eed1-3364-4db3-81da-99284e462cda 1073741824" returned: 0 in 0.519s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f55eed1-3364-4db3-81da-99284e462cda {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:40 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f55eed1-3364-4db3-81da-99284e462cda Sep 25 10:57:40 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:41 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f55eed1-3364-4db3-81da-99284e462cda" returned: 0 in 0.339s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:57:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3736bd6-d186-4fea-81bd-69a2bbfee1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f55eed1-3364-4db3-81da-99284e462cda', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f458b6-a46c-4ce4-9cef-e57e48b0fab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:41 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Volume volume-1f55eed1-3364-4db3-81da-99284e462cda (1f55eed1-3364-4db3-81da-99284e462cda): created successfully Sep 25 10:57:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f458b6-a46c-4ce4-9cef-e57e48b0fab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Flow 'volume_create_manager' (9c7a402b-f986-45c9-ab23-7d26b0061d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:57:41 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-3b126a4a-d8ee-4d4b-899d-b7410b63a308 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Created volume successfully. Sep 25 10:57:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-e536d6cc-c6d0-4518-822b-49ed6088ac5f req-e34b0b81-4284-4281-9b37-ab5732b6c180 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-e536d6cc-c6d0-4518-822b-49ed6088ac5f req-e34b0b81-4284-4281-9b37-ab5732b6c180 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-e536d6cc-c6d0-4518-822b-49ed6088ac5f req-e34b0b81-4284-4281-9b37-ab5732b6c180 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-e536d6cc-c6d0-4518-822b-49ed6088ac5f req-e34b0b81-4284-4281-9b37-ab5732b6c180 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-1f55eed1-3364-4db3-81da-99284e462cda', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9531ce4e-214e-4a6c-af62-4d2664c4cd14', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:57:43 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-e536d6cc-c6d0-4518-822b-49ed6088ac5f req-e34b0b81-4284-4281-9b37-ab5732b6c180 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] attachment_update completed successfully. Sep 25 10:57:46 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-caab53d7-2dc5-4d96-a7cd-4f2293d0e28a req-102eed80-ed0f-47d8-b4fd-3a247f09d57c tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Terminate volume connection completed successfully. Sep 25 10:57:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-caab53d7-2dc5-4d96-a7cd-4f2293d0e28a req-102eed80-ed0f-47d8-b4fd-3a247f09d57c tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Deleting attachment 9531ce4e-214e-4a6c-af62-4d2664c4cd14. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:57:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Acquiring lock "cinder-1f55eed1-3364-4db3-81da-99284e462cda-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Lock "cinder-1f55eed1-3364-4db3-81da-99284e462cda-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Acquiring lock "cinder-quobyte-1f55eed1-3364-4db3-81da-99284e462cda" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:47 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Lock "cinder-quobyte-1f55eed1-3364-4db3-81da-99284e462cda" acquired by "delete_volume" :: waited 0.018s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:47 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fba239-d8f7-4b43-a8fe-5526afcba25c]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f55eed1-3364-4db3-81da-99284e462cda {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:47 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f55eed1-3364-4db3-81da-99284e462cda Sep 25 10:57:47 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:48 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f55eed1-3364-4db3-81da-99284e462cda" returned: 0 in 0.516s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f55eed1-3364-4db3-81da-99284e462cda {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:48 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f55eed1-3364-4db3-81da-99284e462cda Sep 25 10:57:48 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:48 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f55eed1-3364-4db3-81da-99284e462cda" returned: 0 in 0.318s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:48 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Lock "cinder-quobyte-1f55eed1-3364-4db3-81da-99284e462cda" released by "delete_volume" :: held 0.888s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:48 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Created reservations ['a3fa90f4-06d0-4066-b59e-0ac4031e410c', '5a558c00-3f32-4616-99cc-3c58c4f01ecb', '17fdb8dd-7b8c-42c6-85d8-e838a529194d', '55c24f22-187f-46f5-ace4-e841e06d2b88'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:57:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:57:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:57:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:48 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:57:48 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:49 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.374s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:49 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:57:49 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Deleted volume successfully. Sep 25 10:57:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d09bca81-b7cd-428c-b185-35a090cc2e06 tempest-TestServerVolumeAttachScenarioOldVersion-1697960690 None] Lock "cinder-1f55eed1-3364-4db3-81da-99284e462cda-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:58 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=72,cinder:SELECT=70,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:57:59 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=53,cinder:UPDATE=76,cinder:DELETE=7,cinder:INSERT=22 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:58:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:58:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:58:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:58:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:58:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:58:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:58:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:58:26 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:58:26 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:58:26 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Sep 25 10:58:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.250s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:58:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:58:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:58:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:58:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Flow 'volume_create_manager' (9e21d671-cfed-4a16-8d23-a99ac015ca6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa42de5f-fbfa-4d90-b633-6ee6baa63eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa42de5f-fbfa-4d90-b633-6ee6baa63eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1607884832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe888494-439f-457e-960e-e9f8ab971fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8978a306294349e1a0cd19e8bd1a587a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:58:29Z,use_quota=True,user_id='f7fd272ced1a45e1bd9c66f83c1a398e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8069405-23f1-427c-9c3c-c7e75aeed540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8069405-23f1-427c-9c3c-c7e75aeed540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed469f2-913f-4ad1-8c1d-352e158bdf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed469f2-913f-4ad1-8c1d-352e158bdf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe888494-439f-457e-960e-e9f8ab971fcb', 'volume_name': 'volume-fe888494-439f-457e-960e-e9f8ab971fcb', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5591bc92-8369-4965-a676-db1df3ea7fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5591bc92-8369-4965-a676-db1df3ea7fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e73aba-054e-460e-8936-bba7b0ce8f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:58:28 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Volume fe888494-439f-457e-960e-e9f8ab971fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe888494-439f-457e-960e-e9f8ab971fcb', 'volume_size': 1} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1607884832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe888494-439f-457e-960e-e9f8ab971fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8978a306294349e1a0cd19e8bd1a587a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:58:29Z,use_quota=True,user_id='f7fd272ced1a45e1bd9c66f83c1a398e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Creating volume fe888494-439f-457e-960e-e9f8ab971fcb {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:58:28 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 10:58:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fe888494-439f-457e-960e-e9f8ab971fcb 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:58:28 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fe888494-439f-457e-960e-e9f8ab971fcb 1073741824 Sep 25 10:58:28 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:58:29 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 25 10:58:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fe888494-439f-457e-960e-e9f8ab971fcb 1073741824" returned: 0 in 0.557s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:58:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fe888494-439f-457e-960e-e9f8ab971fcb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:58:29 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fe888494-439f-457e-960e-e9f8ab971fcb Sep 25 10:58:29 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:58:29 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 25 10:58:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fe888494-439f-457e-960e-e9f8ab971fcb" returned: 0 in 0.307s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:58:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 10:58:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:58:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e73aba-054e-460e-8936-bba7b0ce8f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe888494-439f-457e-960e-e9f8ab971fcb', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:58:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d678a93-0c3a-4041-9442-8c45520f1f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:58:29 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Volume volume-fe888494-439f-457e-960e-e9f8ab971fcb (fe888494-439f-457e-960e-e9f8ab971fcb): created successfully Sep 25 10:58:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d678a93-0c3a-4041-9442-8c45520f1f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:58:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Flow 'volume_create_manager' (9e21d671-cfed-4a16-8d23-a99ac015ca6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:58:29 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-96978e65-bef8-4b09-a905-fc322aec01c1 tempest-TestMinimumBasicScenario-545804795 None] Created volume successfully. Sep 25 10:58:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-22e6b9ec-4644-4496-8685-4d7aaee369a4 req-83029205-cd49-481f-ab15-11d4a97162d7 tempest-TestMinimumBasicScenario-545804795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:58:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-22e6b9ec-4644-4496-8685-4d7aaee369a4 req-83029205-cd49-481f-ab15-11d4a97162d7 tempest-TestMinimumBasicScenario-545804795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:58:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-22e6b9ec-4644-4496-8685-4d7aaee369a4 req-83029205-cd49-481f-ab15-11d4a97162d7 tempest-TestMinimumBasicScenario-545804795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:58:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-22e6b9ec-4644-4496-8685-4d7aaee369a4 req-83029205-cd49-481f-ab15-11d4a97162d7 tempest-TestMinimumBasicScenario-545804795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-fe888494-439f-457e-960e-e9f8ab971fcb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2f3e957-e20b-4db7-9944-47e27765cc26', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:58:31 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-22e6b9ec-4644-4496-8685-4d7aaee369a4 req-83029205-cd49-481f-ab15-11d4a97162d7 tempest-TestMinimumBasicScenario-545804795 None] attachment_update completed successfully. Sep 25 10:58:41 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:58:41 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:59:21 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-250a83c1-f801-4dcd-a3c9-cf02e5b68478 req-b0b075a2-9d82-4c51-9545-83463452ad3b tempest-TestMinimumBasicScenario-545804795 None] Terminate volume connection completed successfully. Sep 25 10:59:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-250a83c1-f801-4dcd-a3c9-cf02e5b68478 req-b0b075a2-9d82-4c51-9545-83463452ad3b tempest-TestMinimumBasicScenario-545804795 None] Deleting attachment f2f3e957-e20b-4db7-9944-47e27765cc26. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:59:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Acquiring lock "cinder-fe888494-439f-457e-960e-e9f8ab971fcb-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:59:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Lock "cinder-fe888494-439f-457e-960e-e9f8ab971fcb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:59:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Acquiring lock "cinder-quobyte-fe888494-439f-457e-960e-e9f8ab971fcb" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:59:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Lock "cinder-quobyte-fe888494-439f-457e-960e-e9f8ab971fcb" acquired by "delete_volume" :: waited 0.015s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:59:22 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5017ed02-0ac0-4ee8-a171-f857234c9ba5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:59:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fe888494-439f-457e-960e-e9f8ab971fcb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:59:22 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fe888494-439f-457e-960e-e9f8ab971fcb Sep 25 10:59:22 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:59:22 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Sep 25 10:59:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fe888494-439f-457e-960e-e9f8ab971fcb" returned: 0 in 0.385s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:59:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fe888494-439f-457e-960e-e9f8ab971fcb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:59:22 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fe888494-439f-457e-960e-e9f8ab971fcb Sep 25 10:59:22 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:59:23 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 25 10:59:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-fe888494-439f-457e-960e-e9f8ab971fcb" returned: 0 in 0.253s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:59:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Lock "cinder-quobyte-fe888494-439f-457e-960e-e9f8ab971fcb" released by "delete_volume" :: held 0.679s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:59:23 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Created reservations ['5b60253f-ccb8-4c59-b691-a9c10a21b6ea', '57c33f9c-3e05-4039-bf09-f55fb51e8511', '1e7e3719-9cc6-4f32-bbce-bbc36b97c44f', 'd9fc937d-0de2-4b5f-a97a-83ae28186882'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:59:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:59:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:59:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:59:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:59:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:59:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:59:23 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:59:23 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:59:23 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 25 10:59:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.269s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:59:23 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:59:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Deleted volume successfully. Sep 25 10:59:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5156b319-8e8a-454c-9c15-63809a8d7075 tempest-TestMinimumBasicScenario-545804795 None] Lock "cinder-fe888494-439f-457e-960e-e9f8ab971fcb-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:59:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:59:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:59:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:59:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:59:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:59:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:59:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:59:26 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 10:59:26 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:59:26 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 25 10:59:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.312s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:59:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:59:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:59:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:59:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:59:33 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:59:33 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:59:48 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:59:48 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Flow 'volume_create_manager' (b8c37f91-922c-4386-b493-455b4e55f79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e40c257-bef9-467f-9c1d-a75460813e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e40c257-bef9-467f-9c1d-a75460813e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-815946406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffcafad-6d54-4fd9-a751-e662fee6a120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04eb3826eb4f4d44a72e85a911daed3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:00:02Z,use_quota=True,user_id='75911a144efe4e8289e20e2c5e04b53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e5e427-856d-4ee4-abb7-2b8d13ec2844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e5e427-856d-4ee4-abb7-2b8d13ec2844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37380f8b-881a-44f1-b1ad-b63ac6240552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG cinder.image.glance [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Creating Keystone auth plugin from conf {{(pid=86874) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37380f8b-881a-44f1-b1ad-b63ac6240552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ffcafad-6d54-4fd9-a751-e662fee6a120', 'volume_name': 'volume-9ffcafad-6d54-4fd9-a751-e662fee6a120', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f1a08f-df22-4083-9f1e-0402b38f261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f1a08f-df22-4083-9f1e-0402b38f261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5831f02-5ed3-49c1-b84a-133688de6d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:00:02 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Volume 9ffcafad-6d54-4fd9-a751-e662fee6a120: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ffcafad-6d54-4fd9-a751-e662fee6a120', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Trying to clone 9ffcafad-6d54-4fd9-a751-e662fee6a120 from image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]). {{(pid=86874) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_sddrynagdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:00:02 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Image download 20.69 MB at 20.69 MB/s Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f169f21-d4f9-4d26-9a8d-d54257caab9f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:00:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_sddrynagdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:00:03 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_sddrynagdevstack@QuobyteHD Sep 25 11:00:03 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:00:03 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_sddrynagdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Temporary image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 is fetched for user 75911a144efe4e8289e20e2c5e04b53b. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0801c56-883a-4e52-b3cc-9d5cb423085c]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_sddrynagdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:00:03 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_sddrynagdevstack@QuobyteHD Sep 25 11:00:03 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:00:03 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_sddrynagdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-815946406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffcafad-6d54-4fd9-a751-e662fee6a120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04eb3826eb4f4d44a72e85a911daed3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:00:02Z,use_quota=True,user_id='75911a144efe4e8289e20e2c5e04b53b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Creating volume 9ffcafad-6d54-4fd9-a751-e662fee6a120 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:00:03 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:00:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:00:03 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 1073741824 Sep 25 11:00:03 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:00:04 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 25 11:00:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 1073741824" returned: 0 in 0.434s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:00:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:00:04 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 Sep 25 11:00:04 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:00:04 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 25 11:00:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120" returned: 0 in 0.267s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:00:04 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:00:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:00:04 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Attempting download of 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}])) to volume 9ffcafad-6d54-4fd9-a751-e662fee6a120. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 11:00:04 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa6ee11-7474-41d9-b7bf-e9eebf849ac2]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:00:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_psfb8wq5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:00:04 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_psfb8wq5 Sep 25 11:00:04 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:00:04 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 25 11:00:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_psfb8wq5" returned: 0 in 0.425s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:00:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_psfb8wq5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:00:05 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_psfb8wq5 Sep 25 11:00:05 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:00:05 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 25 11:00:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_psfb8wq5" returned: 1 in 0.389s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:00:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_psfb8wq5' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:00:05 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2e8d9f-d781-46f1-9705-ed2f2da6cad1]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:00:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_sddrynagdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:00:05 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_sddrynagdevstack@QuobyteHD Sep 25 11:00:05 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:00:05 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 25 11:00:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_sddrynagdevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:00:05 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 was qcow2, converting to qcow2 {{(pid=86874) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:00:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_sddrynagdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:00:05 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_sddrynagdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 Sep 25 11:00:05 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:00:07 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 25 11:00:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_sddrynagdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120" returned: 0 in 2.005s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:00:07 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_525ec0d5-6fe1-4bae-987e-8b057b5a61d8_sddrynagdevstack@QuobyteHD, size 112.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:00:07 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Converted 112.00 MB image at 55.82 MB/s Sep 25 11:00:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:00:07 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 1G Sep 25 11:00:07 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:00:08 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 25 11:00:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 1G" returned: 0 in 0.330s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:00:08 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Downloaded image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}])) to volume 9ffcafad-6d54-4fd9-a751-e662fee6a120 successfully. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 11:00:08 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Temporary image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 for user 75911a144efe4e8289e20e2c5e04b53b is deleted. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:00:08 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Marking volume 9ffcafad-6d54-4fd9-a751-e662fee6a120 as bootable. {{(pid=86874) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 11:00:08 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Copying metadata from image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 to 9ffcafad-6d54-4fd9-a751-e662fee6a120. {{(pid=86874) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:00:08 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Creating volume glance metadata for volume 9ffcafad-6d54-4fd9-a751-e662fee6a120 backed by image 525ec0d5-6fe1-4bae-987e-8b057b5a61d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86874) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:00:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5831f02-5ed3-49c1-b84a-133688de6d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ffcafad-6d54-4fd9-a751-e662fee6a120', 'volume_size': 1, 'image_id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd000c9b0cea44968900c74b6bd42fb14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '525ec0d5-6fe1-4bae-987e-8b057b5a61d8', 'created_at': datetime.datetime(2026, 9, 25, 8, 32, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 32, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/525ec0d5-6fe1-4bae-987e-8b057b5a61d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:00:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c453cc96-1866-4648-b40c-8bfe3cdbbe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:00:08 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Volume volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 (9ffcafad-6d54-4fd9-a751-e662fee6a120): created successfully Sep 25 11:00:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c453cc96-1866-4648-b40c-8bfe3cdbbe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:00:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Flow 'volume_create_manager' (b8c37f91-922c-4386-b493-455b4e55f79f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:00:08 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-fdc6cfbc-db4a-4ada-8e99-02973ccae4ac tempest-TestShelveInstance-552339067 None] Created volume successfully. Sep 25 11:00:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a50c4fe9-8050-45e5-8c54-83769a4afc5d req-6063ad54-e0d7-476c-8686-c0a3bf4a08b7 tempest-TestShelveInstance-552339067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:00:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a50c4fe9-8050-45e5-8c54-83769a4afc5d req-6063ad54-e0d7-476c-8686-c0a3bf4a08b7 tempest-TestShelveInstance-552339067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:00:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a50c4fe9-8050-45e5-8c54-83769a4afc5d req-6063ad54-e0d7-476c-8686-c0a3bf4a08b7 tempest-TestShelveInstance-552339067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:00:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-a50c4fe9-8050-45e5-8c54-83769a4afc5d req-6063ad54-e0d7-476c-8686-c0a3bf4a08b7 tempest-TestShelveInstance-552339067 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-9ffcafad-6d54-4fd9-a751-e662fee6a120', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d91acc0-7c9d-4007-bdff-d1acac634270', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:00:11 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-a50c4fe9-8050-45e5-8c54-83769a4afc5d req-6063ad54-e0d7-476c-8686-c0a3bf4a08b7 tempest-TestShelveInstance-552339067 None] attachment_update completed successfully. Sep 25 11:00:21 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:INSERT=7 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:00:21 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=18,cinder:INSERT=7,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:00:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:00:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:00:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:00:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:00:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:00:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:00:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:00:26 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:00:26 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:00:26 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Sep 25 11:00:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.300s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:00:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:00:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:00:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:00:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:00:45 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-cb2c787c-0c1f-4aab-a19d-7f0aef78a97a req-84310957-7959-41b3-a07b-d0df0e72c5c9 tempest-TestShelveInstance-552339067 None] Terminate volume connection completed successfully. Sep 25 11:00:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-cb2c787c-0c1f-4aab-a19d-7f0aef78a97a req-84310957-7959-41b3-a07b-d0df0e72c5c9 tempest-TestShelveInstance-552339067 None] Deleting attachment 4d91acc0-7c9d-4007-bdff-d1acac634270. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:00:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-7c8eb4d8-6d1f-4212-9b0e-4fae22d394d2 req-1f78cbb6-8bdd-45d6-a697-a828e3c50166 tempest-TestShelveInstance-552339067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:00:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-7c8eb4d8-6d1f-4212-9b0e-4fae22d394d2 req-1f78cbb6-8bdd-45d6-a697-a828e3c50166 tempest-TestShelveInstance-552339067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:00:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-7c8eb4d8-6d1f-4212-9b0e-4fae22d394d2 req-1f78cbb6-8bdd-45d6-a697-a828e3c50166 tempest-TestShelveInstance-552339067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:00:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-7c8eb4d8-6d1f-4212-9b0e-4fae22d394d2 req-1f78cbb6-8bdd-45d6-a697-a828e3c50166 tempest-TestShelveInstance-552339067 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66', 'name': 'volume-9ffcafad-6d54-4fd9-a751-e662fee6a120', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '115e8667-bcf9-4b0a-9091-9ce3b07d923c', 'enforce_multipath': True} {{(pid=86874) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:00:48 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-7c8eb4d8-6d1f-4212-9b0e-4fae22d394d2 req-1f78cbb6-8bdd-45d6-a697-a828e3c50166 tempest-TestShelveInstance-552339067 None] attachment_update completed successfully. Sep 25 11:00:58 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:00:58 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=11,cinder:UPDATE=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:01:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:01:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:01:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:01:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:01:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:01:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:01:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:26 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:01:26 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:26 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.270s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:01:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:01:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:01:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:01:32 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-222afc83-c715-48b0-b0f6-014c6770ccfa tempest-TestShelveInstance-552339067 None] Terminate volume connection completed successfully. Sep 25 11:01:32 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-222afc83-c715-48b0-b0f6-014c6770ccfa tempest-TestShelveInstance-552339067 None] Deleting attachment 115e8667-bcf9-4b0a-9091-9ce3b07d923c. {{(pid=86874) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:01:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Acquiring lock "cinder-9ffcafad-6d54-4fd9-a751-e662fee6a120-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:01:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Lock "cinder-9ffcafad-6d54-4fd9-a751-e662fee6a120-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:01:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Acquiring lock "cinder-quobyte-9ffcafad-6d54-4fd9-a751-e662fee6a120" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:01:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Lock "cinder-quobyte-9ffcafad-6d54-4fd9-a751-e662fee6a120" acquired by "delete_volume" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:01:33 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bc9101-c800-4967-b21a-8290190a4c1c]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:01:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:33 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 Sep 25 11:01:33 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:33 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120" returned: 0 in 0.416s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:33 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120 Sep 25 11:01:33 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:33 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9ffcafad-6d54-4fd9-a751-e662fee6a120" returned: 0 in 0.252s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Lock "cinder-quobyte-9ffcafad-6d54-4fd9-a751-e662fee6a120" released by "delete_volume" :: held 0.726s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:01:34 devstack cinder-volume[86874]: DEBUG cinder.quota [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Created reservations ['87b76b41-1dac-4cfc-b87f-93b9e59fc4c4', '6da14fc5-82a7-4487-a173-8267f2da4062', 'e5d1c1a7-cf1f-47a5-a35c-a7a14079ac8e', 'a4ba8508-e266-4e19-8307-7a7ad1ebc540'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:01:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:01:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:01:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:01:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:01:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:01:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:34 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:01:34 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:34 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.298s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:34 devstack cinder-volume[86874]: DEBUG cinder.manager [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:01:34 devstack cinder-volume[86874]: INFO cinder.volume.manager [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Deleted volume successfully. Sep 25 11:01:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [req-a091a1fa-fc3f-41b0-acf1-ee1ee405c19d req-e1ab3079-f5ba-4eee-bf12-4d19ab060403 tempest-TestShelveInstance-552339067 None] Lock "cinder-9ffcafad-6d54-4fd9-a751-e662fee6a120-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:01:44 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Flow 'volume_create_manager' (a4c10450-5206-4d68-9a83-dcc7025ee58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e1afc2-c816-439b-9a0e-65a27f9ca074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e1afc2-c816-439b-9a0e-65a27f9ca074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1471884451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c01902f0-d40f-458d-a43b-413fdea4cd11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a43be91d2e4ef3a0e6a5086e89d4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:01:47Z,use_quota=True,user_id='aee1eb5b95394ac7b7fe0e70a6829670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbcd763-1139-478b-acb3-87432ebd007b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbcd763-1139-478b-acb3-87432ebd007b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623964ac-f4c8-4c3a-ae98-cbdf8c10c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623964ac-f4c8-4c3a-ae98-cbdf8c10c72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c01902f0-d40f-458d-a43b-413fdea4cd11', 'volume_name': 'volume-c01902f0-d40f-458d-a43b-413fdea4cd11', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db201b87-299f-497a-a160-7b39734b18a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db201b87-299f-497a-a160-7b39734b18a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339799e4-d683-4927-803a-91bbd22a1466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:01:47 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Volume c01902f0-d40f-458d-a43b-413fdea4cd11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c01902f0-d40f-458d-a43b-413fdea4cd11', 'volume_size': 1} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1471884451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c01902f0-d40f-458d-a43b-413fdea4cd11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a43be91d2e4ef3a0e6a5086e89d4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:01:47Z,use_quota=True,user_id='aee1eb5b95394ac7b7fe0e70a6829670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Creating volume c01902f0-d40f-458d-a43b-413fdea4cd11 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:01:47 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:47 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 1073741824 Sep 25 11:01:47 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:47 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 1073741824" returned: 0 in 0.442s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:48 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 Sep 25 11:01:48 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:48 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11" returned: 0 in 0.239s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:01:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:01:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339799e4-d683-4927-803a-91bbd22a1466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c01902f0-d40f-458d-a43b-413fdea4cd11', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:01:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b836d21a-6e28-4214-bffc-ff68a6b7edfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:01:48 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Volume volume-c01902f0-d40f-458d-a43b-413fdea4cd11 (c01902f0-d40f-458d-a43b-413fdea4cd11): created successfully Sep 25 11:01:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b836d21a-6e28-4214-bffc-ff68a6b7edfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:01:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Flow 'volume_create_manager' (a4c10450-5206-4d68-9a83-dcc7025ee58e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:01:48 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bc6779ef-8794-4d4d-a398-74db1d098914 tempest-VolumeDependencyTests-2103593319 None] Created volume successfully. Sep 25 11:01:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:01:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:01:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] Creating offline snapshot 54296890-7e20-4f9c-b5e8-a220f2054654 of volume c01902f0-d40f-458d-a43b-413fdea4cd11 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:01:48 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0650ff8-ec1e-4531-82e1-fef88f0e7551]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:01:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:48 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 Sep 25 11:01:48 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:49 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11" returned: 0 in 0.411s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:49 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 1G Sep 25 11:01:49 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:49 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 1G" returned: 0 in 0.419s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01902f0-d40f-458d-a43b-413fdea4cd11 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:49 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01902f0-d40f-458d-a43b-413fdea4cd11 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 Sep 25 11:01:49 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:49 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01902f0-d40f-458d-a43b-413fdea4cd11 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654" returned: 0 in 0.320s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:49 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 is being set with open permissions: ugo+rw Sep 25 11:01:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:49 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 Sep 25 11:01:49 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:50 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654" returned: 0 in 0.252s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:50 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.info Sep 25 11:01:50 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:50 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.info" returned: 0 in 0.261s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:50 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.info is being set with open permissions: ugo+rw Sep 25 11:01:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:50 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.info Sep 25 11:01:50 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:50 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.info" returned: 0 in 0.238s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:01:50 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-e4d3e5e1-16d4-4c30-b31d-4ec0ce91f081 tempest-VolumeDependencyTests-2103593319 None] Create snapshot completed successfully Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Flow 'volume_create_manager' (e36a9f88-479f-4319-8b93-ebb79f37d6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fc5658-1546-4040-956f-c5c1ff04bffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fc5658-1546-4040-956f-c5c1ff04bffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-91050254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b169cf7-f19a-4689-b148-a0b28340f727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a43be91d2e4ef3a0e6a5086e89d4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=54296890-7e20-4f9c-b5e8-a220f2054654,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:01:51Z,use_quota=True,user_id='aee1eb5b95394ac7b7fe0e70a6829670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec106b09-e04f-4ddb-bc29-079fd83f7852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec106b09-e04f-4ddb-bc29-079fd83f7852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5251b184-9da8-4220-b738-4ed1857b40d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5251b184-9da8-4220-b738-4ed1857b40d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b169cf7-f19a-4689-b148-a0b28340f727', 'volume_name': 'volume-7b169cf7-f19a-4689-b148-a0b28340f727', 'volume_size': 1, 'snapshot_id': '54296890-7e20-4f9c-b5e8-a220f2054654'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d66806-c974-46b2-b236-ba9dbad5ea7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d66806-c974-46b2-b236-ba9dbad5ea7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e121d2-ab2f-4691-a0d6-69c50953de49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:01:51 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Volume 7b169cf7-f19a-4689-b148-a0b28340f727: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b169cf7-f19a-4689-b148-a0b28340f727', 'volume_size': 1, 'snapshot_id': '54296890-7e20-4f9c-b5e8-a220f2054654'} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "cinder-quobyte-54296890-7e20-4f9c-b5e8-a220f2054654-7b169cf7-f19a-4689-b148-a0b28340f727" by "_create_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-quobyte-54296890-7e20-4f9c-b5e8-a220f2054654-7b169cf7-f19a-4689-b148-a0b28340f727" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Creating volume 7b169cf7-f19a-4689-b148-a0b28340f727 from snapshot 54296890-7e20-4f9c-b5e8-a220f2054654 {{(pid=86874) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "cinder-quobyte-7b169cf7-f19a-4689-b148-a0b28340f727" by "_copy_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-quobyte-7b169cf7-f19a-4689-b148-a0b28340f727" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] snapshot: 54296890-7e20-4f9c-b5e8-a220f2054654, volume: 7b169cf7-f19a-4689-b148-a0b28340f727, {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6262cbd6-1247-4599-a807-4341f387bf4d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:51 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 Sep 25 11:01:51 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:51 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654" returned: 0 in 0.359s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c01902f0-d40f-458d-a43b-413fdea4cd11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[366dff1a-3c91-4d74-8e2f-89de7a90494c]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:01:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:51 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 Sep 25 11:01:51 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:52 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11" returned: 0 in 0.401s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] will copy from snapshot at /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:01:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Creating direct copy from snapshot {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:01:52 devstack cinder-volume[86874]: DEBUG cinder.utils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Path /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727 not found in is_blk_device check {{(pid=86874) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 11:01:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:52 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727 Sep 25 11:01:52 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:58 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727" returned: 0 in 5.869s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:01:58 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Converted 1024.00 MB image at 174.41 MB/s Sep 25 11:01:58 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727 is being set with open permissions: ugo+rw Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:58 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727 Sep 25 11:01:58 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:58 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727" returned: 0 in 0.258s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-quobyte-7b169cf7-f19a-4689-b148-a0b28340f727" released by "_copy_volume_from_snapshot" :: held 6.974s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-quobyte-54296890-7e20-4f9c-b5e8-a220f2054654-7b169cf7-f19a-4689-b148-a0b28340f727" released by "_create_volume_from_snapshot" :: held 7.034s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.048s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e121d2-ab2f-4691-a0d6-69c50953de49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b169cf7-f19a-4689-b148-a0b28340f727', 'volume_size': 1, 'snapshot_id': '54296890-7e20-4f9c-b5e8-a220f2054654'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0772821-9183-419d-8e61-3cd9d171c2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:01:58 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Volume volume-7b169cf7-f19a-4689-b148-a0b28340f727 (7b169cf7-f19a-4689-b148-a0b28340f727): created successfully Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0772821-9183-419d-8e61-3cd9d171c2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Flow 'volume_create_manager' (e36a9f88-479f-4319-8b93-ebb79f37d6aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:01:58 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a7136f55-1115-4d61-bfb6-847c4a277cd4 tempest-VolumeDependencyTests-2103593319 None] Created volume successfully. Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "cinder-54296890-7e20-4f9c-b5e8-a220f2054654-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-54296890-7e20-4f9c-b5e8-a220f2054654-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "cinder-quobyte-c01902f0-d40f-458d-a43b-413fdea4cd11" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-quobyte-c01902f0-d40f-458d-a43b-413fdea4cd11" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "cinder-quobyte-54296890-7e20-4f9c-b5e8-a220f2054654" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-quobyte-54296890-7e20-4f9c-b5e8-a220f2054654" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Deleting offline snapshot 54296890-7e20-4f9c-b5e8-a220f2054654 of volume c01902f0-d40f-458d-a43b-413fdea4cd11 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] snapshot_file for this snap is: volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[726ffac3-fa6f-492d-9247-150eac9d0206]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:01:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:58 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 Sep 25 11:01:58 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:59 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654" returned: 0 in 0.370s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c01902f0-d40f-458d-a43b-413fdea4cd11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:01:59 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd0fcaa-58a3-4431-8164-9ffab774b541]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:01:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:59 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 Sep 25 11:01:59 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:01:59 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 25 11:01:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11" returned: 0 in 0.528s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:01:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:01:59 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 Sep 25 11:01:59 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:00 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654" returned: 0 in 0.320s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:00 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654 Sep 25 11:02:00 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:00 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11.54296890-7e20-4f9c-b5e8-a220f2054654" returned: 0 in 0.243s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-quobyte-54296890-7e20-4f9c-b5e8-a220f2054654" released by "_delete_snapshot" :: held 1.558s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-quobyte-c01902f0-d40f-458d-a43b-413fdea4cd11" released by "delete_snapshot" :: held 1.580s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:00 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Created reservations ['858bcee9-4358-4a04-92f2-68be50f82dd3', '6d8d077b-5122-4bd8-bd88-b5cb590bb310', '96f41b32-4326-4514-9b38-9b3e2550baa7', '14d584d8-efa0-4db7-b6fe-78429aa9e320'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:02:00 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Delete snapshot completed successfully. Sep 25 11:02:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6d62762-10a2-448a-9ab3-eb6dcf040af5 tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-54296890-7e20-4f9c-b5e8-a220f2054654-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "cinder-c01902f0-d40f-458d-a43b-413fdea4cd11-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-c01902f0-d40f-458d-a43b-413fdea4cd11-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "cinder-quobyte-c01902f0-d40f-458d-a43b-413fdea4cd11" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-quobyte-c01902f0-d40f-458d-a43b-413fdea4cd11" acquired by "delete_volume" :: waited 0.014s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41bc93f-0744-471a-ae71-c1501c1477db]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:01 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 Sep 25 11:02:01 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:01 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11" returned: 0 in 0.346s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:01 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11 Sep 25 11:02:01 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:01 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c01902f0-d40f-458d-a43b-413fdea4cd11" returned: 0 in 0.252s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-quobyte-c01902f0-d40f-458d-a43b-413fdea4cd11" released by "delete_volume" :: held 0.660s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Created reservations ['4f51287e-5b68-4d25-a0f0-0f03d7e813c3', '3f82c608-b3d1-4882-84ca-8ab92a25afbf', '08e665f9-a7e1-454c-be9f-898793234f7a', '28b4d193-4626-40dc-8029-d958f6ad62d8'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:01 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:02:01 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:02 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.244s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:02:02 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Deleted volume successfully. Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cd5f6085-1a7b-4e4e-8bd7-bdc3b897dbc9 tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-c01902f0-d40f-458d-a43b-413fdea4cd11-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "cinder-7b169cf7-f19a-4689-b148-a0b28340f727-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-7b169cf7-f19a-4689-b148-a0b28340f727-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "cinder-quobyte-7b169cf7-f19a-4689-b148-a0b28340f727" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-quobyte-7b169cf7-f19a-4689-b148-a0b28340f727" acquired by "delete_volume" :: waited 0.015s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e63f3b-0599-4050-b80d-bcce270e7614]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:02 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727 Sep 25 11:02:02 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:02 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727" returned: 0 in 0.345s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:02 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727 Sep 25 11:02:02 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:02 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-7b169cf7-f19a-4689-b148-a0b28340f727" returned: 0 in 0.245s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-quobyte-7b169cf7-f19a-4689-b148-a0b28340f727" released by "delete_volume" :: held 0.634s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Created reservations ['e7bc948a-1f9c-4bdb-9701-b8e7f1bd3f70', '9b22c42d-41b5-469e-a55f-bac702349bac', 'dbb8ccc4-de17-4256-8ac6-183924a24e5e', 'c4af2d77-4558-4c5a-b22a-45b6f0e33188'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:02 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:02:02 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:03 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.260s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:03 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:02:03 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Deleted volume successfully. Sep 25 11:02:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-de85b055-2609-49db-81d3-6dda5ba302fb tempest-VolumeDependencyTests-2103593319 None] Lock "cinder-7b169cf7-f19a-4689-b148-a0b28340f727-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Flow 'volume_create_manager' (06c9be86-543d-496a-82b3-68cea33a5783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037121b0-4a24-43e3-ade5-400d34c19381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037121b0-4a24-43e3-ade5-400d34c19381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1084706932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff17d94-8a51-40f9-92d0-765f7ac52953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20fec82474a446ba135ca0204765b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:07Z,use_quota=True,user_id='5fedecf347434dddb39cedff76992af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bea36f-79e2-4e99-a401-0c52c5a4a33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bea36f-79e2-4e99-a401-0c52c5a4a33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a232c032-31da-491c-ac01-6f60851d8b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a232c032-31da-491c-ac01-6f60851d8b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ff17d94-8a51-40f9-92d0-765f7ac52953', 'volume_name': 'volume-3ff17d94-8a51-40f9-92d0-765f7ac52953', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe2f442-cfcc-4e58-9e9f-6f2d9be8669f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe2f442-cfcc-4e58-9e9f-6f2d9be8669f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779f7f2a-783e-4962-be6b-8f9d0d29261f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:06 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Volume 3ff17d94-8a51-40f9-92d0-765f7ac52953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ff17d94-8a51-40f9-92d0-765f7ac52953', 'volume_size': 1} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1084706932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff17d94-8a51-40f9-92d0-765f7ac52953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20fec82474a446ba135ca0204765b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:07Z,use_quota=True,user_id='5fedecf347434dddb39cedff76992af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Creating volume 3ff17d94-8a51-40f9-92d0-765f7ac52953 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:02:06 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:02:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3ff17d94-8a51-40f9-92d0-765f7ac52953 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:06 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3ff17d94-8a51-40f9-92d0-765f7ac52953 1073741824 Sep 25 11:02:06 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:07 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3ff17d94-8a51-40f9-92d0-765f7ac52953 1073741824" returned: 0 in 0.414s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3ff17d94-8a51-40f9-92d0-765f7ac52953 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:07 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3ff17d94-8a51-40f9-92d0-765f7ac52953 Sep 25 11:02:07 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:07 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3ff17d94-8a51-40f9-92d0-765f7ac52953" returned: 0 in 0.240s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:02:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779f7f2a-783e-4962-be6b-8f9d0d29261f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff17d94-8a51-40f9-92d0-765f7ac52953', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21ff7c3-c113-4ad8-86c2-d370b1685b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:07 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Volume volume-3ff17d94-8a51-40f9-92d0-765f7ac52953 (3ff17d94-8a51-40f9-92d0-765f7ac52953): created successfully Sep 25 11:02:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21ff7c3-c113-4ad8-86c2-d370b1685b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Flow 'volume_create_manager' (06c9be86-543d-496a-82b3-68cea33a5783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:07 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f8a47d5b-b551-48b3-a37f-08ce9d5c32ce tempest-ProjectReaderTests-1140601162 None] Created volume successfully. Sep 25 11:02:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Acquiring lock "cinder-3ff17d94-8a51-40f9-92d0-765f7ac52953-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Lock "cinder-3ff17d94-8a51-40f9-92d0-765f7ac52953-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Acquiring lock "cinder-quobyte-3ff17d94-8a51-40f9-92d0-765f7ac52953" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Lock "cinder-quobyte-3ff17d94-8a51-40f9-92d0-765f7ac52953" acquired by "delete_volume" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:08 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[195f8c60-8fda-4b2b-a3ed-612a3cd67687]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3ff17d94-8a51-40f9-92d0-765f7ac52953 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:08 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3ff17d94-8a51-40f9-92d0-765f7ac52953 Sep 25 11:02:08 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:08 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3ff17d94-8a51-40f9-92d0-765f7ac52953" returned: 0 in 0.420s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3ff17d94-8a51-40f9-92d0-765f7ac52953 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:08 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3ff17d94-8a51-40f9-92d0-765f7ac52953 Sep 25 11:02:08 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:08 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3ff17d94-8a51-40f9-92d0-765f7ac52953" returned: 0 in 0.297s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Lock "cinder-quobyte-3ff17d94-8a51-40f9-92d0-765f7ac52953" released by "delete_volume" :: held 0.768s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:08 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Created reservations ['55dc8da5-3ed5-46ab-a40f-acb18d0f4a40', '17984e62-1863-41c4-8457-12e4970338e9', 'ba36c86a-5823-46e0-ae96-46670e43d13a', '34ed3e23-3ae8-483e-818e-54c2549f5e9c'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:02:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:09 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:02:09 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:09 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.264s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:02:09 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Deleted volume successfully. Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5205403b-d5fb-4556-b657-218d43fb3d29 tempest-ProjectReaderTests-1140601162 None] Lock "cinder-3ff17d94-8a51-40f9-92d0-765f7ac52953-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Flow 'volume_create_manager' (c667bb0d-4a70-4406-bf36-e8554b41d4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf84baa-1c6e-4051-ac79-41423c7e7c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf84baa-1c6e-4051-ac79-41423c7e7c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2145764411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=547209c8-c828-4afb-93ff-e5ef1ba26642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20fec82474a446ba135ca0204765b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:10Z,use_quota=True,user_id='5fedecf347434dddb39cedff76992af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f284944-52e6-4a85-9d5c-9d09b22e14da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f284944-52e6-4a85-9d5c-9d09b22e14da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77db9116-8eba-4340-b571-5e22ee300b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77db9116-8eba-4340-b571-5e22ee300b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '547209c8-c828-4afb-93ff-e5ef1ba26642', 'volume_name': 'volume-547209c8-c828-4afb-93ff-e5ef1ba26642', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9ed596-15b1-46d3-9722-f8e1753f1f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9ed596-15b1-46d3-9722-f8e1753f1f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34be97b9-68bf-4e40-a3a8-c10899f144ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:09 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Volume 547209c8-c828-4afb-93ff-e5ef1ba26642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-547209c8-c828-4afb-93ff-e5ef1ba26642', 'volume_size': 1} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2145764411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=547209c8-c828-4afb-93ff-e5ef1ba26642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20fec82474a446ba135ca0204765b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:10Z,use_quota=True,user_id='5fedecf347434dddb39cedff76992af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Creating volume 547209c8-c828-4afb-93ff-e5ef1ba26642 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:02:09 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:02:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-547209c8-c828-4afb-93ff-e5ef1ba26642 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:09 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-547209c8-c828-4afb-93ff-e5ef1ba26642 1073741824 Sep 25 11:02:09 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:10 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-547209c8-c828-4afb-93ff-e5ef1ba26642 1073741824" returned: 0 in 0.414s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-547209c8-c828-4afb-93ff-e5ef1ba26642 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:10 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-547209c8-c828-4afb-93ff-e5ef1ba26642 Sep 25 11:02:10 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:10 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-547209c8-c828-4afb-93ff-e5ef1ba26642" returned: 0 in 0.262s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34be97b9-68bf-4e40-a3a8-c10899f144ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-547209c8-c828-4afb-93ff-e5ef1ba26642', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a7a74b-0132-43f9-8b55-3aa185a94764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:10 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Volume volume-547209c8-c828-4afb-93ff-e5ef1ba26642 (547209c8-c828-4afb-93ff-e5ef1ba26642): created successfully Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a7a74b-0132-43f9-8b55-3aa185a94764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Flow 'volume_create_manager' (c667bb0d-4a70-4406-bf36-e8554b41d4c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:10 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2a457083-2538-4b15-beeb-4acf3480cc39 tempest-ProjectReaderTests-1140601162 None] Created volume successfully. Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Acquiring lock "cinder-547209c8-c828-4afb-93ff-e5ef1ba26642-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Lock "cinder-547209c8-c828-4afb-93ff-e5ef1ba26642-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Acquiring lock "cinder-quobyte-547209c8-c828-4afb-93ff-e5ef1ba26642" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Lock "cinder-quobyte-547209c8-c828-4afb-93ff-e5ef1ba26642" acquired by "delete_volume" :: waited 0.018s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76f5eee-dd98-4add-a499-9b3de1517481]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-547209c8-c828-4afb-93ff-e5ef1ba26642 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:10 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-547209c8-c828-4afb-93ff-e5ef1ba26642 Sep 25 11:02:10 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:11 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-547209c8-c828-4afb-93ff-e5ef1ba26642" returned: 0 in 0.368s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-547209c8-c828-4afb-93ff-e5ef1ba26642 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:11 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-547209c8-c828-4afb-93ff-e5ef1ba26642 Sep 25 11:02:11 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:11 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-547209c8-c828-4afb-93ff-e5ef1ba26642" returned: 0 in 0.244s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Lock "cinder-quobyte-547209c8-c828-4afb-93ff-e5ef1ba26642" released by "delete_volume" :: held 0.654s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:11 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Created reservations ['d41066c5-470f-4325-861d-3530afe29f18', '9ec7c4e1-d410-4b7a-b74a-1a2ff868c254', '7d139d94-5735-45ee-88f4-7e2097674e73', '8c22ff41-239f-4362-a79a-4876670cf9e9'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:02:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:11 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:11 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:11 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:02:11 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:11 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.302s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:11 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:02:11 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Deleted volume successfully. Sep 25 11:02:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-73aba08e-c6e2-4f76-bb60-3783332a0a1e tempest-ProjectReaderTests-1140601162 None] Lock "cinder-547209c8-c828-4afb-93ff-e5ef1ba26642-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Flow 'volume_create_manager' (550b2336-e82d-4d04-8de2-8f9afb4afaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3049c3-7118-46cf-a41d-595a540ed7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3049c3-7118-46cf-a41d-595a540ed7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072042616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c8b66b-ccfc-4630-bff6-26a571c1d0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce444cecfc4f38ab529e32e04f57ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:15Z,use_quota=True,user_id='a244c1567d7c48baaa4fd9aa9c362b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a5e92b-ce9b-4f6e-9868-718a21ea01cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a5e92b-ce9b-4f6e-9868-718a21ea01cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff555393-9b4c-4f88-b429-e52e847de22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff555393-9b4c-4f88-b429-e52e847de22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8c8b66b-ccfc-4630-bff6-26a571c1d0b2', 'volume_name': 'volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd424f08-1b47-4cb3-bba7-e0e2c90379c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd424f08-1b47-4cb3-bba7-e0e2c90379c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b501b22-6853-4dc6-a0c2-41c7f9453d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:15 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Volume b8c8b66b-ccfc-4630-bff6-26a571c1d0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2', 'volume_size': 1} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072042616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c8b66b-ccfc-4630-bff6-26a571c1d0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce444cecfc4f38ab529e32e04f57ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:15Z,use_quota=True,user_id='a244c1567d7c48baaa4fd9aa9c362b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Creating volume b8c8b66b-ccfc-4630-bff6-26a571c1d0b2 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:02:15 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:02:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:15 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2 1073741824 Sep 25 11:02:15 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:16 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2 1073741824" returned: 0 in 0.415s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:16 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2 Sep 25 11:02:16 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:16 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2" returned: 0 in 0.266s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b501b22-6853-4dc6-a0c2-41c7f9453d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ffe484-44da-4d66-9103-391b0493af8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:16 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Volume volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2 (b8c8b66b-ccfc-4630-bff6-26a571c1d0b2): created successfully Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ffe484-44da-4d66-9103-391b0493af8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Flow 'volume_create_manager' (550b2336-e82d-4d04-8de2-8f9afb4afaef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6389461c-9130-4703-aed2-4cda87c1daa4 tempest-ProjectReaderTests-1861925116 None] Created volume successfully. Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Acquiring lock "cinder-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Lock "cinder-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Acquiring lock "cinder-quobyte-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Lock "cinder-quobyte-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2" acquired by "delete_volume" :: waited 0.014s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5a5fdc-da5a-41a5-87cc-cbd4b321ab6d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:16 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2 Sep 25 11:02:16 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:17 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2" returned: 0 in 0.411s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:17 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2 Sep 25 11:02:17 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:17 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2" returned: 0 in 0.264s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Lock "cinder-quobyte-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2" released by "delete_volume" :: held 0.723s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:17 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Created reservations ['9e54910e-1ade-44e4-99cb-6861f84b2240', '63cf1bae-3072-4a7e-82ae-c22ed99cc342', 'ee9020d0-6976-4213-bfd9-42c116053738', 'f1470e44-4c60-4591-87ac-6686ad9e949f'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:02:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:17 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:02:17 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:17 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.305s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:17 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:02:17 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Deleted volume successfully. Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6371bc7d-306c-48a7-8c5a-66f7367e2ff1 tempest-ProjectReaderTests-1861925116 None] Lock "cinder-b8c8b66b-ccfc-4630-bff6-26a571c1d0b2-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Flow 'volume_create_manager' (0aadaa17-1329-437c-b054-14e4cd127b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f0064e-7bcc-44f7-bb84-b6acef586146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f0064e-7bcc-44f7-bb84-b6acef586146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226502793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0d8338-0df6-4a06-aeca-5da77b3695fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce444cecfc4f38ab529e32e04f57ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:19Z,use_quota=True,user_id='a244c1567d7c48baaa4fd9aa9c362b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20787fbb-beb0-43b8-9f6e-63c28a691b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20787fbb-beb0-43b8-9f6e-63c28a691b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a00e52d-0010-484f-8dda-dd868d3c1969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a00e52d-0010-484f-8dda-dd868d3c1969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d0d8338-0df6-4a06-aeca-5da77b3695fb', 'volume_name': 'volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (581f2eae-55f9-4f54-8ed4-36ffcf9d54a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (581f2eae-55f9-4f54-8ed4-36ffcf9d54a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0310e0a3-6fbf-4f55-b18c-0cbbbe006096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:18 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Volume 5d0d8338-0df6-4a06-aeca-5da77b3695fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb', 'volume_size': 1} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226502793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0d8338-0df6-4a06-aeca-5da77b3695fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce444cecfc4f38ab529e32e04f57ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:19Z,use_quota=True,user_id='a244c1567d7c48baaa4fd9aa9c362b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Creating volume 5d0d8338-0df6-4a06-aeca-5da77b3695fb {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:02:18 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:02:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:18 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb 1073741824 Sep 25 11:02:18 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:19 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb 1073741824" returned: 0 in 0.432s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:19 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb Sep 25 11:02:19 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:19 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb" returned: 0 in 0.256s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0310e0a3-6fbf-4f55-b18c-0cbbbe006096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3dabbb-52f2-4b76-8f8e-ce2bef0bb368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:19 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Volume volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb (5d0d8338-0df6-4a06-aeca-5da77b3695fb): created successfully Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3dabbb-52f2-4b76-8f8e-ce2bef0bb368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Flow 'volume_create_manager' (0aadaa17-1329-437c-b054-14e4cd127b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:19 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2006a9dc-ba19-426d-bf59-55c63ad38adc tempest-ProjectReaderTests-1861925116 None] Created volume successfully. Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Acquiring lock "cinder-5d0d8338-0df6-4a06-aeca-5da77b3695fb-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Lock "cinder-5d0d8338-0df6-4a06-aeca-5da77b3695fb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Acquiring lock "cinder-quobyte-5d0d8338-0df6-4a06-aeca-5da77b3695fb" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Lock "cinder-quobyte-5d0d8338-0df6-4a06-aeca-5da77b3695fb" acquired by "delete_volume" :: waited 0.018s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece68d74-eba2-4d32-b210-ed0e86b2b4a5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:20 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb Sep 25 11:02:20 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:20 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb" returned: 0 in 0.375s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:20 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb Sep 25 11:02:20 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:20 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5d0d8338-0df6-4a06-aeca-5da77b3695fb" returned: 0 in 0.253s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Lock "cinder-quobyte-5d0d8338-0df6-4a06-aeca-5da77b3695fb" released by "delete_volume" :: held 0.674s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:20 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Created reservations ['d1a8c341-33f4-4cbf-ac46-e5c11cefc24a', 'f6162b01-d2a1-49c1-a43a-7d180aebf961', 'caba12f2-93ce-44f3-8f44-ac61fcc85523', '54225fc1-1b73-495a-b62c-e236a1a68992'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:02:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:20 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:20 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:02:20 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:21 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.275s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:02:21 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Deleted volume successfully. Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-309ab9f5-db1d-4cc2-a8f9-b4333f21803b tempest-ProjectReaderTests-1861925116 None] Lock "cinder-5d0d8338-0df6-4a06-aeca-5da77b3695fb-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Flow 'volume_create_manager' (f6fe9354-c162-40b4-8c5c-bd6dfde62732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb87d1f-75b3-420a-9706-3cdc3b5be54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb87d1f-75b3-420a-9706-3cdc3b5be54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-282672577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce444cecfc4f38ab529e32e04f57ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:21Z,use_quota=True,user_id='a244c1567d7c48baaa4fd9aa9c362b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361c092e-472e-4873-881a-236e4d4f94e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361c092e-472e-4873-881a-236e4d4f94e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c69a422f-3cfe-49c5-9373-10160d8b77a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c69a422f-3cfe-49c5-9373-10160d8b77a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5', 'volume_name': 'volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ba1389-2363-4f67-9540-3b2ef4002e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ba1389-2363-4f67-9540-3b2ef4002e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7c0b0b-f71d-44b7-b792-4dbb9c04ada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:21 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Volume 5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5', 'volume_size': 1} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-282672577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce444cecfc4f38ab529e32e04f57ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:21Z,use_quota=True,user_id='a244c1567d7c48baaa4fd9aa9c362b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Creating volume 5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:02:21 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:02:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:21 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5 1073741824 Sep 25 11:02:21 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:22 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5 1073741824" returned: 0 in 0.448s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:22 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5 Sep 25 11:02:22 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:22 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5" returned: 0 in 0.244s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7c0b0b-f71d-44b7-b792-4dbb9c04ada7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e59271-4d9a-4835-b52c-8d045143ddb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:22 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Volume volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5 (5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5): created successfully Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e59271-4d9a-4835-b52c-8d045143ddb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Flow 'volume_create_manager' (f6fe9354-c162-40b4-8c5c-bd6dfde62732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:22 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ee5fcb2f-8871-4191-a5ff-45ab680d926e tempest-ProjectReaderTests-1861925116 None] Created volume successfully. Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Acquiring lock "cinder-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Lock "cinder-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Acquiring lock "cinder-quobyte-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Lock "cinder-quobyte-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5" acquired by "delete_volume" :: waited 0.014s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bc1067-44a4-480e-8755-0c089c4106bf]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:22 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5 Sep 25 11:02:22 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:23 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5" returned: 0 in 0.402s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:23 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5 Sep 25 11:02:23 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:23 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5" returned: 0 in 0.259s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Lock "cinder-quobyte-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5" released by "delete_volume" :: held 0.708s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:23 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Created reservations ['0c3d47c5-9bfd-41ed-aace-9ebcf0b0019b', '62568fbb-f76d-4421-ad40-5092b4a9d7f4', '8e1e20cf-580c-48d4-bce7-20340fdfb681', '7bd3ff1c-9347-44be-883d-5429e9b86341'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:02:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:23 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:02:23 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:23 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.285s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:23 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:02:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Deleted volume successfully. Sep 25 11:02:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-629b1356-12c5-4fa6-9508-f4bcf53ad452 tempest-ProjectReaderTests-1861925116 None] Lock "cinder-5bab8d5c-a3d1-48bf-a62d-d387e8d4c8c5-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Flow 'volume_create_manager' (d0c72800-d46d-47c1-af69-8ad6d5c7db4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9586b1e1-7925-4551-a234-c14e6af35483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9586b1e1-7925-4551-a234-c14e6af35483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398826225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626d9388-77cf-44d7-8708-648bd2b23b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce444cecfc4f38ab529e32e04f57ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:24Z,use_quota=True,user_id='a244c1567d7c48baaa4fd9aa9c362b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c12227f-840a-4e1a-883c-549b12140afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c12227f-840a-4e1a-883c-549b12140afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd95560b-c0d1-4887-948d-0ff78a1caea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd95560b-c0d1-4887-948d-0ff78a1caea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '626d9388-77cf-44d7-8708-648bd2b23b92', 'volume_name': 'volume-626d9388-77cf-44d7-8708-648bd2b23b92', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c1bb2e-bd53-416c-9d75-de20f3762375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c1bb2e-bd53-416c-9d75-de20f3762375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a845cbd1-7f64-4b08-b67a-b70ff8015c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:24 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Volume 626d9388-77cf-44d7-8708-648bd2b23b92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-626d9388-77cf-44d7-8708-648bd2b23b92', 'volume_size': 1} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398826225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626d9388-77cf-44d7-8708-648bd2b23b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ce444cecfc4f38ab529e32e04f57ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:24Z,use_quota=True,user_id='a244c1567d7c48baaa4fd9aa9c362b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Creating volume 626d9388-77cf-44d7-8708-648bd2b23b92 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:02:24 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-626d9388-77cf-44d7-8708-648bd2b23b92 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:24 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-626d9388-77cf-44d7-8708-648bd2b23b92 1073741824 Sep 25 11:02:24 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:24 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-626d9388-77cf-44d7-8708-648bd2b23b92 1073741824" returned: 0 in 0.416s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-626d9388-77cf-44d7-8708-648bd2b23b92 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:24 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-626d9388-77cf-44d7-8708-648bd2b23b92 Sep 25 11:02:24 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:25 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-626d9388-77cf-44d7-8708-648bd2b23b92" returned: 0 in 0.254s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a845cbd1-7f64-4b08-b67a-b70ff8015c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-626d9388-77cf-44d7-8708-648bd2b23b92', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0892a6e8-0e09-4678-948d-f63fc2b99c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:25 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Volume volume-626d9388-77cf-44d7-8708-648bd2b23b92 (626d9388-77cf-44d7-8708-648bd2b23b92): created successfully Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0892a6e8-0e09-4678-948d-f63fc2b99c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Flow 'volume_create_manager' (d0c72800-d46d-47c1-af69-8ad6d5c7db4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:25 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-210ecf45-028b-4d7c-b355-175c7da60d78 tempest-ProjectReaderTests-1861925116 None] Created volume successfully. Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Acquiring lock "cinder-626d9388-77cf-44d7-8708-648bd2b23b92-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Lock "cinder-626d9388-77cf-44d7-8708-648bd2b23b92-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Acquiring lock "cinder-quobyte-626d9388-77cf-44d7-8708-648bd2b23b92" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Lock "cinder-quobyte-626d9388-77cf-44d7-8708-648bd2b23b92" acquired by "delete_volume" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e4c049-9118-48a3-bdff-cb552916f82b]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-626d9388-77cf-44d7-8708-648bd2b23b92 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:25 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-626d9388-77cf-44d7-8708-648bd2b23b92 Sep 25 11:02:25 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:25 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-626d9388-77cf-44d7-8708-648bd2b23b92" returned: 0 in 0.373s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-626d9388-77cf-44d7-8708-648bd2b23b92 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:25 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-626d9388-77cf-44d7-8708-648bd2b23b92 Sep 25 11:02:25 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:26 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-626d9388-77cf-44d7-8708-648bd2b23b92" returned: 0 in 0.258s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Lock "cinder-quobyte-626d9388-77cf-44d7-8708-648bd2b23b92" released by "delete_volume" :: held 0.673s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Created reservations ['bdf4e946-0484-4064-adbf-b7c0e05f6d79', 'c08d3b40-5d1c-463c-a094-0595210fa641', 'a254bcbc-b696-4c65-b6c1-9502508fa01e', '54667585-695f-4741-b973-f3cace3a7efc'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:26 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:02:26 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:26 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:02:26 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:26 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.285s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:02:26 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.290s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:02:26 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Deleted volume successfully. Sep 25 11:02:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6c80a7f9-4a91-4f88-9405-2fdfc91c7216 tempest-ProjectReaderTests-1861925116 None] Lock "cinder-626d9388-77cf-44d7-8708-648bd2b23b92-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:36 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=69,cinder:UPDATE=92,cinder:INSERT=24,cinder:DELETE=9 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:02:36 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=70,cinder:INSERT=22,cinder:UPDATE=106,cinder:DELETE=8 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Flow 'volume_create_manager' (e7a6f72e-d627-41c7-bb37-a1d040ef694d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3393dc-cf02-49fc-8170-fc08c05545cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3393dc-cf02-49fc-8170-fc08c05545cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-754437540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c987431-0470-40fa-b0ba-3d66cefebb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b33dbda98b34761805ac4417e9270cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:39Z,use_quota=True,user_id='a125d2ea5fd34057aa96415e041cd136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22cacd17-afe2-4088-a787-4b12a90f38cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22cacd17-afe2-4088-a787-4b12a90f38cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3846d6b1-8758-4486-9538-66aba91aa1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3846d6b1-8758-4486-9538-66aba91aa1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c987431-0470-40fa-b0ba-3d66cefebb81', 'volume_name': 'volume-1c987431-0470-40fa-b0ba-3d66cefebb81', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1263e9b-bd5c-4153-8519-cd9707823c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1263e9b-bd5c-4153-8519-cd9707823c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8051213e-44ec-4424-9313-d97cbabc1a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:39 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Volume 1c987431-0470-40fa-b0ba-3d66cefebb81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c987431-0470-40fa-b0ba-3d66cefebb81', 'volume_size': 1} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-754437540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c987431-0470-40fa-b0ba-3d66cefebb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b33dbda98b34761805ac4417e9270cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:39Z,use_quota=True,user_id='a125d2ea5fd34057aa96415e041cd136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Creating volume 1c987431-0470-40fa-b0ba-3d66cefebb81 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:02:39 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:39 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 1073741824 Sep 25 11:02:39 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:39 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 1073741824" returned: 0 in 0.580s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:40 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 Sep 25 11:02:40 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Flow 'volume_create_manager' (1a06ac5c-908f-442e-8876-8b6dbf24cd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42de3cbb-a7a8-47f3-9bbc-92f09401e0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:40 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42de3cbb-a7a8-47f3-9bbc-92f09401e0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1904519449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61bd36df-3cdc-4a93-b026-bd943b911d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b373014b145d3b12caed689bd7e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:40Z,use_quota=True,user_id='e0132ff0d0894d68b96926aa3c4e9743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3688a3e-093e-45a0-8236-1bfc9af81a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3688a3e-093e-45a0-8236-1bfc9af81a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515df93a-7816-46f0-80fc-07206498cf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515df93a-7816-46f0-80fc-07206498cf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61bd36df-3cdc-4a93-b026-bd943b911d34', 'volume_name': 'volume-61bd36df-3cdc-4a93-b026-bd943b911d34', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bc3b49-a0db-4be7-aab9-1790cbea9886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bc3b49-a0db-4be7-aab9-1790cbea9886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690845e6-3d6a-4c5e-b272-f2ed09421654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:40 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume 61bd36df-3cdc-4a93-b026-bd943b911d34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61bd36df-3cdc-4a93-b026-bd943b911d34', 'volume_size': 1} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81" returned: 0 in 0.442s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1904519449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61bd36df-3cdc-4a93-b026-bd943b911d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b373014b145d3b12caed689bd7e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:40Z,use_quota=True,user_id='e0132ff0d0894d68b96926aa3c4e9743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Creating volume 61bd36df-3cdc-4a93-b026-bd943b911d34 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:02:40 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8051213e-44ec-4424-9313-d97cbabc1a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c987431-0470-40fa-b0ba-3d66cefebb81', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:40 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34 1073741824 Sep 25 11:02:40 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc89475d-fbdc-42ce-8331-7bedbe1f4ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:40 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Volume volume-1c987431-0470-40fa-b0ba-3d66cefebb81 (1c987431-0470-40fa-b0ba-3d66cefebb81): created successfully Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc89475d-fbdc-42ce-8331-7bedbe1f4ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Flow 'volume_create_manager' (e7a6f72e-d627-41c7-bb37-a1d040ef694d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:40 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5d95ce19-7c40-4518-a771-3a44f4cad2fa tempest-VolumeDependencyTests-847073250 None] Created volume successfully. Sep 25 11:02:41 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34 1073741824" returned: 0 in 0.544s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:41 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34 Sep 25 11:02:41 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:41 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34" returned: 0 in 0.330s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:02:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690845e6-3d6a-4c5e-b272-f2ed09421654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61bd36df-3cdc-4a93-b026-bd943b911d34', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c46180-d12a-489b-9466-060aa514d479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:41 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume volume-61bd36df-3cdc-4a93-b026-bd943b911d34 (61bd36df-3cdc-4a93-b026-bd943b911d34): created successfully Sep 25 11:02:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c46180-d12a-489b-9466-060aa514d479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Flow 'volume_create_manager' (1a06ac5c-908f-442e-8876-8b6dbf24cd6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:41 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7b8489eb-c8ab-4783-9635-59531e068bc8 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Created volume successfully. Sep 25 11:02:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] Creating offline snapshot 50833c03-7102-4e31-abf4-38aa737612bc of volume 1c987431-0470-40fa-b0ba-3d66cefebb81 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:02:41 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a875260f-605a-46ad-b9d3-50cbebcacb2e]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:41 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 Sep 25 11:02:41 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:42 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81" returned: 0 in 0.476s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:42 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc 1G Sep 25 11:02:42 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:42 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc 1G" returned: 0 in 0.588s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c987431-0470-40fa-b0ba-3d66cefebb81 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:42 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c987431-0470-40fa-b0ba-3d66cefebb81 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc Sep 25 11:02:42 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:43 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c987431-0470-40fa-b0ba-3d66cefebb81 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc" returned: 0 in 0.376s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:43 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc is being set with open permissions: ugo+rw Sep 25 11:02:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:43 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc Sep 25 11:02:43 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:43 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc" returned: 0 in 0.317s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:43 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.info Sep 25 11:02:43 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:43 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.info" returned: 0 in 0.379s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:43 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.info is being set with open permissions: ugo+rw Sep 25 11:02:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:43 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.info Sep 25 11:02:43 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:44 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.info" returned: 0 in 0.351s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.610s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.614s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Creating offline snapshot 27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec of volume 61bd36df-3cdc-4a93-b026-bd943b911d34 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:02:44 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-68e461e3-18f4-48eb-95ce-4c6c4e14c811 tempest-VolumeDependencyTests-847073250 None] Create snapshot completed successfully Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[152929d3-bd43-417f-b7ee-8f54ab03fc6e]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:44 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34 Sep 25 11:02:44 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:44 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34" returned: 0 in 0.468s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:44 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec 1G Sep 25 11:02:44 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Flow 'volume_create_manager' (2c61f99c-d131-43a8-888c-965570ec95fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a807f0a-a10b-4a6f-8d16-8d6b21d4240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a807f0a-a10b-4a6f-8d16-8d6b21d4240f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6adb6a-a2b6-4298-8e0c-1499883f1887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd197eb3fb3e45abbe1207d36ee350e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:45Z,use_quota=True,user_id='4224c626694f440cab301c737f248987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76ba07a2-edfe-412f-8d58-f4a1af51280c),volume_type_id=76ba07a2-edfe-412f-8d58-f4a1af51280c)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdd1e85-8a06-449d-a1af-50445ebd33eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdd1e85-8a06-449d-a1af-50445ebd33eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd13815-d714-4018-94a3-ba36ee73cdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:44 devstack cinder-volume[86874]: DEBUG cinder.image.glance [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Creating Keystone auth plugin from conf {{(pid=86874) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:02:45 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec 1G" returned: 0 in 0.653s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bd36df-3cdc-4a93-b026-bd943b911d34 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:45 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bd36df-3cdc-4a93-b026-bd943b911d34 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec Sep 25 11:02:45 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Flow 'volume_create_manager' (fff11c64-7ca4-4155-80d5-c342e2ae1dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1106bf-20f5-439b-b766-e27c77fff271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1106bf-20f5-439b-b766-e27c77fff271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1855159062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b277349-a331-4446-af9c-1a28932f2b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b33dbda98b34761805ac4417e9270cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=50833c03-7102-4e31-abf4-38aa737612bc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:46Z,use_quota=True,user_id='a125d2ea5fd34057aa96415e041cd136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4ae8fa-24fc-4ea2-9197-72f074aa0f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4ae8fa-24fc-4ea2-9197-72f074aa0f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab73328-7068-4b0d-82fa-e1bd68f8ebed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab73328-7068-4b0d-82fa-e1bd68f8ebed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8b277349-a331-4446-af9c-1a28932f2b02', 'volume_name': 'volume-8b277349-a331-4446-af9c-1a28932f2b02', 'volume_size': 1, 'snapshot_id': '50833c03-7102-4e31-abf4-38aa737612bc'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb0e7e4-e43e-48b2-8e14-e5f177fcae83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb0e7e4-e43e-48b2-8e14-e5f177fcae83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1978ba89-0e3e-442b-be9e-3744a9a9f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:45 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Volume 8b277349-a331-4446-af9c-1a28932f2b02: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8b277349-a331-4446-af9c-1a28932f2b02', 'volume_size': 1, 'snapshot_id': '50833c03-7102-4e31-abf4-38aa737612bc'} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:45 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bd36df-3cdc-4a93-b026-bd943b911d34 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec" returned: 0 in 0.452s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:45 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec is being set with open permissions: ugo+rw Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd13815-d714-4018-94a3-ba36ee73cdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f6adb6a-a2b6-4298-8e0c-1499883f1887', 'volume_name': 'volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887', 'volume_size': 1, 'image_id': '61ef832a-4f4d-4127-98fb-58d5cef54743', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61ef832a-4f4d-4127-98fb-58d5cef54743', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6690a0b4c0449e6af338d44a8e02c77a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd197eb3fb3e45abbe1207d36ee350e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a2e103f5a9d0e5922ae7b73ce77096b4516c336be55ac3cb16e54bd124775a8adb08f1747c1c9fcb9961a5df6740a2179dd1f3f35aa8fe0e128d4dc4d43ff161', 'id': '61ef832a-4f4d-4127-98fb-58d5cef54743', 'created_at': datetime.datetime(2026, 9, 25, 9, 2, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 2, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61ef832a-4f4d-4127-98fb-58d5cef54743/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a8023f-19bc-4497-b62b-61f4141ba469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:45 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec Sep 25 11:02:45 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a8023f-19bc-4497-b62b-61f4141ba469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df26c3e2-aac7-4246-a363-4aa6ad98dd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:45 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Volume 1f6adb6a-a2b6-4298-8e0c-1499883f1887: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887', 'volume_size': 1, 'image_id': '61ef832a-4f4d-4127-98fb-58d5cef54743', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61ef832a-4f4d-4127-98fb-58d5cef54743', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6690a0b4c0449e6af338d44a8e02c77a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd197eb3fb3e45abbe1207d36ee350e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a2e103f5a9d0e5922ae7b73ce77096b4516c336be55ac3cb16e54bd124775a8adb08f1747c1c9fcb9961a5df6740a2179dd1f3f35aa8fe0e128d4dc4d43ff161', 'id': '61ef832a-4f4d-4127-98fb-58d5cef54743', 'created_at': datetime.datetime(2026, 9, 25, 9, 2, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 2, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61ef832a-4f4d-4127-98fb-58d5cef54743/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 11:02:45 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Trying to clone 1f6adb6a-a2b6-4298-8e0c-1499883f1887 from image 61ef832a-4f4d-4127-98fb-58d5cef54743 at location (None, [{'url': 'file:///opt/stack/data/glance/images/61ef832a-4f4d-4127-98fb-58d5cef54743', 'metadata': {}}]). {{(pid=86874) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:02:46 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Image download 0.00 MB at 0.00 MB/s Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32faf0a-c4bb-4873-92cd-8f84116b40a4]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:46 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec" returned: 0 in 0.299s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:46 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD Sep 25 11:02:46 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:46 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.info Sep 25 11:02:46 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:46 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:46 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.info" returned: 0 in 0.297s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:46 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.info is being set with open permissions: ugo+rw Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:46 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.info Sep 25 11:02:46 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:46 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD Sep 25 11:02:46 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (8dc5e3b2-7b25-426c-a883-023945cf0292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d088f359-e61d-4a54-909c-1848d19129de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d088f359-e61d-4a54-909c-1848d19129de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-190141241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f51f64-c591-4fff-8ef7-52c834d3f038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:47Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37134bed-5baa-4d35-824c-fcf22bd7f78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37134bed-5baa-4d35-824c-fcf22bd7f78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23fe8b25-d4fa-43bd-b7a9-f936a412a030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:46 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23fe8b25-d4fa-43bd-b7a9-f936a412a030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f51f64-c591-4fff-8ef7-52c834d3f038', 'volume_name': 'volume-b0f51f64-c591-4fff-8ef7-52c834d3f038', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1172a3c-69ba-4b21-9da0-ea5f1c8390e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1172a3c-69ba-4b21-9da0-ea5f1c8390e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1df11ae-a7e5-42ac-b649-1f877e08fc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:46 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Volume b0f51f64-c591-4fff-8ef7-52c834d3f038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f51f64-c591-4fff-8ef7-52c834d3f038', 'volume_size': 1} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.info" returned: 0 in 0.372s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:46 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.104s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Acquiring lock "cinder-quobyte-50833c03-7102-4e31-abf4-38aa737612bc-8b277349-a331-4446-af9c-1a28932f2b02" by "_create_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD" returned: 1 in 0.471s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Temporary image 61ef832a-4f4d-4127-98fb-58d5cef54743 is fetched for user 4224c626694f440cab301c737f248987. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Lock "cinder-quobyte-50833c03-7102-4e31-abf4-38aa737612bc-8b277349-a331-4446-af9c-1a28932f2b02" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Creating volume 8b277349-a331-4446-af9c-1a28932f2b02 from snapshot 50833c03-7102-4e31-abf4-38aa737612bc {{(pid=86874) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Acquiring lock "cinder-quobyte-8b277349-a331-4446-af9c-1a28932f2b02" by "_copy_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:46 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-9bfc202a-249a-43ca-a506-be230afc2749 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Create snapshot completed successfully Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Lock "cinder-quobyte-8b277349-a331-4446-af9c-1a28932f2b02" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] snapshot: 50833c03-7102-4e31-abf4-38aa737612bc, volume: 8b277349-a331-4446-af9c-1a28932f2b02, {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90f7010-17c3-4f97-9ac3-9bab4765692a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63ab6c4-40d9-4612-8aa2-7fda9e46e2bf]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:47 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc Sep 25 11:02:47 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:47 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD Sep 25 11:02:47 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:47 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:47 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc" returned: 0 in 0.393s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c987431-0470-40fa-b0ba-3d66cefebb81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[805c676f-33ae-48b0-9e7f-4706618b570b]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:47 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD Sep 25 11:02:47 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:47 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 Sep 25 11:02:47 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:47 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:47 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81" returned: 0 in 0.413s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] will copy from snapshot at /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Creating direct copy from snapshot {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG cinder.utils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Path /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02 not found in is_blk_device check {{(pid=86874) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 11:02:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:47 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02 Sep 25 11:02:47 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:48 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Flow 'volume_create_manager' (ac99a623-1123-4c19-aacf-bffc704dfdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b39b20f-a5ff-48cb-adc8-490e60dbbf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b39b20f-a5ff-48cb-adc8-490e60dbbf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1736097857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50a4b7b6-ec19-4e73-b159-457b1b726063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b373014b145d3b12caed689bd7e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:48Z,use_quota=True,user_id='e0132ff0d0894d68b96926aa3c4e9743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ee48fd-143e-4abe-8202-83ebf44a5410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ee48fd-143e-4abe-8202-83ebf44a5410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f0d876-ac81-44e1-b79b-64a5040747eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f0d876-ac81-44e1-b79b-64a5040747eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50a4b7b6-ec19-4e73-b159-457b1b726063', 'volume_name': 'volume-50a4b7b6-ec19-4e73-b159-457b1b726063', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a8082ba-3e7f-4ac7-ba53-6dd3deaefdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a8082ba-3e7f-4ac7-ba53-6dd3deaefdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ccc833b-f560-469a-88c9-eb5396d7d088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:48 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume 50a4b7b6-ec19-4e73-b159-457b1b726063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50a4b7b6-ec19-4e73-b159-457b1b726063', 'volume_size': 1} Sep 25 11:02:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Flow 'volume_create_manager' (bc751607-578b-4ff6-b8a2-3ad698a4c94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecfd6df-6a47-40c1-adc6-5caaa73dbe07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecfd6df-6a47-40c1-adc6-5caaa73dbe07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1583186924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6744fee9-af48-450f-a158-2f3bfe6b8185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b373014b145d3b12caed689bd7e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:49Z,use_quota=True,user_id='e0132ff0d0894d68b96926aa3c4e9743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2e123b-6792-4021-9e14-cf3c09e58f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2e123b-6792-4021-9e14-cf3c09e58f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb02d3d4-25cd-4b8f-93d7-489b24dbc1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb02d3d4-25cd-4b8f-93d7-489b24dbc1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6744fee9-af48-450f-a158-2f3bfe6b8185', 'volume_name': 'volume-6744fee9-af48-450f-a158-2f3bfe6b8185', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80683646-3191-472b-b71d-82c7d220b24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80683646-3191-472b-b71d-82c7d220b24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f59bbd-df18-44db-9d8f-db88d90fd997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:49 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume 6744fee9-af48-450f-a158-2f3bfe6b8185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6744fee9-af48-450f-a158-2f3bfe6b8185', 'volume_size': 1} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Flow 'volume_create_manager' (7c76c70e-3423-4f1a-9f28-fc458fd483e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b7f09b-1e67-410f-b9b4-d86031e4040a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b7f09b-1e67-410f-b9b4-d86031e4040a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1549327517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73bc9372-2dd8-48eb-93c2-6542d442bc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b373014b145d3b12caed689bd7e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:50Z,use_quota=True,user_id='e0132ff0d0894d68b96926aa3c4e9743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8abf44c-4295-46e9-bda9-8ccb67111669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8abf44c-4295-46e9-bda9-8ccb67111669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f996f6-c0ee-4075-b7f6-112dcf2dee1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f996f6-c0ee-4075-b7f6-112dcf2dee1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73bc9372-2dd8-48eb-93c2-6542d442bc0a', 'volume_name': 'volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4e05f9-32a9-4701-a36a-986dcf4114ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:50 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4e05f9-32a9-4701-a36a-986dcf4114ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:50 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f893c8d-44aa-4838-89dc-46a97f2f2379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:50 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume 73bc9372-2dd8-48eb-93c2-6542d442bc0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a', 'volume_size': 1} Sep 25 11:02:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:50 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Flow 'volume_create_manager' (d1b14a1c-fff5-4f6b-a302-bf2d0f88969e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e561824f-754f-4b9d-b598-b4cba65a1ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e561824f-754f-4b9d-b598-b4cba65a1ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-125037193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d580e4f-f6eb-49a2-9270-d528209b3d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b373014b145d3b12caed689bd7e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:51Z,use_quota=True,user_id='e0132ff0d0894d68b96926aa3c4e9743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76894ede-6093-465a-b486-d23c142b9898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76894ede-6093-465a-b486-d23c142b9898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d201e9-a663-4f83-abc9-41683bdf6ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d201e9-a663-4f83-abc9-41683bdf6ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d580e4f-f6eb-49a2-9270-d528209b3d13', 'volume_name': 'volume-2d580e4f-f6eb-49a2-9270-d528209b3d13', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23962918-03f1-4dcc-9063-9dfc1a748a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23962918-03f1-4dcc-9063-9dfc1a748a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ae4624-6b2a-438c-9095-269e18b98aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:51 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume 2d580e4f-f6eb-49a2-9270-d528209b3d13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d580e4f-f6eb-49a2-9270-d528209b3d13', 'volume_size': 1} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Flow 'volume_create_manager' (55f71597-b26f-4227-bfca-67fcd56c6a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4f207f-ff2a-4958-96a7-0ef6005bb295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4f207f-ff2a-4958-96a7-0ef6005bb295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1519472234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e188f9-73e7-4ba9-a063-74a405fcafca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b373014b145d3b12caed689bd7e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:52Z,use_quota=True,user_id='e0132ff0d0894d68b96926aa3c4e9743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a2e735-386c-4627-8a55-28168eb6d574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a2e735-386c-4627-8a55-28168eb6d574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e339e3c-8ea1-4181-8071-c77a77689b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e339e3c-8ea1-4181-8071-c77a77689b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e188f9-73e7-4ba9-a063-74a405fcafca', 'volume_name': 'volume-a8e188f9-73e7-4ba9-a063-74a405fcafca', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9183bae0-cab1-425b-be9a-86564d80cfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9183bae0-cab1-425b-be9a-86564d80cfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b2469b8-e32c-4c7d-8285-d4e4554a0d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:52 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume a8e188f9-73e7-4ba9-a063-74a405fcafca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e188f9-73e7-4ba9-a063-74a405fcafca', 'volume_size': 1} Sep 25 11:02:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:55 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02" returned: 0 in 7.884s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:55 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81, size 1024.00 MB, duration 7.88 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:02:55 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Converted 1024.00 MB image at 129.87 MB/s Sep 25 11:02:55 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02 is being set with open permissions: ugo+rw Sep 25 11:02:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:55 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02 Sep 25 11:02:55 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:55 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02" returned: 0 in 0.252s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Lock "cinder-quobyte-8b277349-a331-4446-af9c-1a28932f2b02" released by "_copy_volume_from_snapshot" :: held 9.039s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Lock "cinder-quobyte-50833c03-7102-4e31-abf4-38aa737612bc-8b277349-a331-4446-af9c-1a28932f2b02" released by "_create_volume_from_snapshot" :: held 9.135s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.177s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.205s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-190141241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f51f64-c591-4fff-8ef7-52c834d3f038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:47Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Creating volume b0f51f64-c591-4fff-8ef7-52c834d3f038 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:02:56 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:56 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 1073741824 Sep 25 11:02:56 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1978ba89-0e3e-442b-be9e-3744a9a9f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b277349-a331-4446-af9c-1a28932f2b02', 'volume_size': 1, 'snapshot_id': '50833c03-7102-4e31-abf4-38aa737612bc'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3cf504-0268-456f-be9a-a0614a2a572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:56 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Volume volume-8b277349-a331-4446-af9c-1a28932f2b02 (8b277349-a331-4446-af9c-1a28932f2b02): created successfully Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3cf504-0268-456f-be9a-a0614a2a572c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Flow 'volume_create_manager' (fff11c64-7ca4-4155-80d5-c342e2ae1dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:56 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-22c905e2-4739-47f3-bad3-6d9b54076a84 tempest-VolumeDependencyTests-847073250 None] Created volume successfully. Sep 25 11:02:56 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 1073741824" returned: 0 in 0.461s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:56 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 Sep 25 11:02:56 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Acquiring lock "cinder-50833c03-7102-4e31-abf4-38aa737612bc-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Lock "cinder-50833c03-7102-4e31-abf4-38aa737612bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Acquiring lock "cinder-quobyte-1c987431-0470-40fa-b0ba-3d66cefebb81" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Lock "cinder-quobyte-1c987431-0470-40fa-b0ba-3d66cefebb81" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Acquiring lock "cinder-quobyte-50833c03-7102-4e31-abf4-38aa737612bc" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Lock "cinder-quobyte-50833c03-7102-4e31-abf4-38aa737612bc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Deleting offline snapshot 50833c03-7102-4e31-abf4-38aa737612bc of volume 1c987431-0470-40fa-b0ba-3d66cefebb81 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] snapshot_file for this snap is: volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:02:56 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038" returned: 0 in 0.293s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.107s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6adb6a-a2b6-4298-8e0c-1499883f1887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd197eb3fb3e45abbe1207d36ee350e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:45Z,use_quota=True,user_id='4224c626694f440cab301c737f248987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76ba07a2-edfe-412f-8d58-f4a1af51280c),volume_type_id=76ba07a2-edfe-412f-8d58-f4a1af51280c)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Creating volume 1f6adb6a-a2b6-4298-8e0c-1499883f1887 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:02:56 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf76e5f-8ec7-43fb-83bb-fadf7addb74e]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:56 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 1073741824 Sep 25 11:02:56 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1df11ae-a7e5-42ac-b649-1f877e08fc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f51f64-c591-4fff-8ef7-52c834d3f038', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8771a55-34a4-4481-81ac-111813500002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:56 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Volume volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 (b0f51f64-c591-4fff-8ef7-52c834d3f038): created successfully Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8771a55-34a4-4481-81ac-111813500002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:56 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (8dc5e3b2-7b25-426c-a883-023945cf0292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:56 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8f21de32-c3bf-4ce6-850d-75e56aa46271 tempest-ProjectMemberTests-1612262589 None] Created volume successfully. Sep 25 11:02:57 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc Sep 25 11:02:57 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:57 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc" returned: 0 in 0.462s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c987431-0470-40fa-b0ba-3d66cefebb81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[00823993-fb68-453e-b482-834abc42a4e3]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:57 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 1073741824" returned: 0 in 0.519s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:57 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 Sep 25 11:02:57 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:57 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 Sep 25 11:02:57 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:57 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887" returned: 0 in 0.243s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.187s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1736097857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50a4b7b6-ec19-4e73-b159-457b1b726063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b373014b145d3b12caed689bd7e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:48Z,use_quota=True,user_id='e0132ff0d0894d68b96926aa3c4e9743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Creating volume 50a4b7b6-ec19-4e73-b159-457b1b726063 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:02:57 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-50a4b7b6-ec19-4e73-b159-457b1b726063 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:57 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-50a4b7b6-ec19-4e73-b159-457b1b726063 1073741824 Sep 25 11:02:57 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Attempting download of 61ef832a-4f4d-4127-98fb-58d5cef54743 ((None, [{'url': 'file:///opt/stack/data/glance/images/61ef832a-4f4d-4127-98fb-58d5cef54743', 'metadata': {}}])) to volume 1f6adb6a-a2b6-4298-8e0c-1499883f1887. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f0dc56-923d-46b7-bfe4-4fec540a9760]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61ef832a-4f4d-4127-98fb-58d5cef54743_zyxvw6uy {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:57 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61ef832a-4f4d-4127-98fb-58d5cef54743_zyxvw6uy Sep 25 11:02:57 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:58 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81" returned: 0 in 0.649s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:58 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc Sep 25 11:02:58 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:58 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61ef832a-4f4d-4127-98fb-58d5cef54743_zyxvw6uy" returned: 0 in 0.400s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61ef832a-4f4d-4127-98fb-58d5cef54743_zyxvw6uy {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:58 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-50a4b7b6-ec19-4e73-b159-457b1b726063 1073741824" returned: 0 in 0.593s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:58 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61ef832a-4f4d-4127-98fb-58d5cef54743_zyxvw6uy Sep 25 11:02:58 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-50a4b7b6-ec19-4e73-b159-457b1b726063 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:58 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-50a4b7b6-ec19-4e73-b159-457b1b726063 Sep 25 11:02:58 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:58 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc" returned: 0 in 0.535s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:58 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc Sep 25 11:02:58 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:58 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61ef832a-4f4d-4127-98fb-58d5cef54743_zyxvw6uy" returned: 1 in 0.448s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61ef832a-4f4d-4127-98fb-58d5cef54743_zyxvw6uy' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbc40fb-0a9f-4188-834d-1e272c083b5f]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:58 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-50a4b7b6-ec19-4e73-b159-457b1b726063" returned: 0 in 0.348s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.363s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1583186924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6744fee9-af48-450f-a158-2f3bfe6b8185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b373014b145d3b12caed689bd7e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:49Z,use_quota=True,user_id='e0132ff0d0894d68b96926aa3c4e9743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Creating volume 6744fee9-af48-450f-a158-2f3bfe6b8185 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:02:58 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6744fee9-af48-450f-a158-2f3bfe6b8185 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:58 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD Sep 25 11:02:58 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6744fee9-af48-450f-a158-2f3bfe6b8185 1073741824 Sep 25 11:02:58 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:58 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ccc833b-f560-469a-88c9-eb5396d7d088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50a4b7b6-ec19-4e73-b159-457b1b726063', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecfb633-c51b-47f0-acbc-00a84f9a6fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:58 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume volume-50a4b7b6-ec19-4e73-b159-457b1b726063 (50a4b7b6-ec19-4e73-b159-457b1b726063): created successfully Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecfb633-c51b-47f0-acbc-00a84f9a6fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Flow 'volume_create_manager' (ac99a623-1123-4c19-aacf-bffc704dfdf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:58 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-e9ad9e7b-39cc-4ef4-ad66-c0acc6e33eb7 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Created volume successfully. Sep 25 11:02:58 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81.50833c03-7102-4e31-abf4-38aa737612bc" returned: 0 in 0.284s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Lock "cinder-quobyte-50833c03-7102-4e31-abf4-38aa737612bc" released by "_delete_snapshot" :: held 2.090s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Lock "cinder-quobyte-1c987431-0470-40fa-b0ba-3d66cefebb81" released by "delete_snapshot" :: held 2.115s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Created reservations ['07cb7704-7d0b-46be-aa6a-64277c2d16cd', 'cd37e4c6-62c7-4301-88ba-d797d813f416', 'f4662d6d-1d20-40ab-acc2-c494b3a93657', '397a139b-704c-42ac-aaa9-4ffd2e5d76cf'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:02:59 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:59 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Delete snapshot completed successfully. Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b59b0ad8-f979-47ac-a12a-e69ab3e6caed tempest-VolumeDependencyTests-847073250 None] Lock "cinder-50833c03-7102-4e31-abf4-38aa737612bc-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:02:59 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD Sep 25 11:02:59 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:59 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6744fee9-af48-450f-a158-2f3bfe6b8185 1073741824" returned: 0 in 0.515s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6744fee9-af48-450f-a158-2f3bfe6b8185 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:59 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6744fee9-af48-450f-a158-2f3bfe6b8185 Sep 25 11:02:59 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:59 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] 61ef832a-4f4d-4127-98fb-58d5cef54743 was raw, converting to qcow2 {{(pid=86874) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:59 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 Sep 25 11:02:59 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:59 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6744fee9-af48-450f-a158-2f3bfe6b8185" returned: 0 in 0.278s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.620s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1549327517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73bc9372-2dd8-48eb-93c2-6542d442bc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b373014b145d3b12caed689bd7e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:50Z,use_quota=True,user_id='e0132ff0d0894d68b96926aa3c4e9743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Creating volume 73bc9372-2dd8-48eb-93c2-6542d442bc0a {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:02:59 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f59bbd-df18-44db-9d8f-db88d90fd997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6744fee9-af48-450f-a158-2f3bfe6b8185', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:59 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a 1073741824 Sep 25 11:02:59 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001b2c09-04c4-47c2-84a9-963fdd60ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:02:59 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume volume-6744fee9-af48-450f-a158-2f3bfe6b8185 (6744fee9-af48-450f-a158-2f3bfe6b8185): created successfully Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001b2c09-04c4-47c2-84a9-963fdd60ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Flow 'volume_create_manager' (bc751607-578b-4ff6-b8a2-3ad698a4c94a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:02:59 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6bb4c1de-67d9-4ad9-be34-f06063abd42c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Created volume successfully. Sep 25 11:02:59 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887" returned: 0 in 0.518s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_61ef832a-4f4d-4127-98fb-58d5cef54743_mwfq70lydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:02:59 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 11:02:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:00 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 1G Sep 25 11:03:00 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Acquiring lock "cinder-1c987431-0470-40fa-b0ba-3d66cefebb81-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Lock "cinder-1c987431-0470-40fa-b0ba-3d66cefebb81-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Acquiring lock "cinder-quobyte-1c987431-0470-40fa-b0ba-3d66cefebb81" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Lock "cinder-quobyte-1c987431-0470-40fa-b0ba-3d66cefebb81" acquired by "delete_volume" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[37acb8c5-b5af-49d5-9529-0f9e1c2bda25]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:00 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a 1073741824" returned: 0 in 0.563s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:00 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a Sep 25 11:03:00 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:00 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 Sep 25 11:03:00 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:00 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 1G" returned: 0 in 0.446s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Downloaded image 61ef832a-4f4d-4127-98fb-58d5cef54743 ((None, [{'url': 'file:///opt/stack/data/glance/images/61ef832a-4f4d-4127-98fb-58d5cef54743', 'metadata': {}}])) to volume 1f6adb6a-a2b6-4298-8e0c-1499883f1887 successfully. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Temporary image 61ef832a-4f4d-4127-98fb-58d5cef54743 for user 4224c626694f440cab301c737f248987 is deleted. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Marking volume 1f6adb6a-a2b6-4298-8e0c-1499883f1887 as bootable. {{(pid=86874) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Copying metadata from image 61ef832a-4f4d-4127-98fb-58d5cef54743 to 1f6adb6a-a2b6-4298-8e0c-1499883f1887. {{(pid=86874) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Creating volume glance metadata for volume 1f6adb6a-a2b6-4298-8e0c-1499883f1887 backed by image 61ef832a-4f4d-4127-98fb-58d5cef54743 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '61ef832a-4f4d-4127-98fb-58d5cef54743', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6690a0b4c0449e6af338d44a8e02c77a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86874) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:03:00 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a" returned: 0 in 0.406s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.424s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-125037193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d580e4f-f6eb-49a2-9270-d528209b3d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b373014b145d3b12caed689bd7e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:51Z,use_quota=True,user_id='e0132ff0d0894d68b96926aa3c4e9743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Creating volume 2d580e4f-f6eb-49a2-9270-d528209b3d13 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:00 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d580e4f-f6eb-49a2-9270-d528209b3d13 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:00 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81" returned: 0 in 0.491s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:00 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d580e4f-f6eb-49a2-9270-d528209b3d13 1073741824 Sep 25 11:03:00 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df26c3e2-aac7-4246-a363-4aa6ad98dd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887', 'volume_size': 1, 'image_id': '61ef832a-4f4d-4127-98fb-58d5cef54743', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61ef832a-4f4d-4127-98fb-58d5cef54743', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6690a0b4c0449e6af338d44a8e02c77a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd197eb3fb3e45abbe1207d36ee350e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a2e103f5a9d0e5922ae7b73ce77096b4516c336be55ac3cb16e54bd124775a8adb08f1747c1c9fcb9961a5df6740a2179dd1f3f35aa8fe0e128d4dc4d43ff161', 'id': '61ef832a-4f4d-4127-98fb-58d5cef54743', 'created_at': datetime.datetime(2026, 9, 25, 9, 2, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 2, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61ef832a-4f4d-4127-98fb-58d5cef54743/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e60503-502b-4f3d-9fc7-7d54123e7180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:00 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81 Sep 25 11:03:00 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f893c8d-44aa-4838-89dc-46a97f2f2379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a62d48-c692-41c5-ac18-0d3319b543e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:00 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Volume volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 (1f6adb6a-a2b6-4298-8e0c-1499883f1887): created successfully Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e60503-502b-4f3d-9fc7-7d54123e7180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Flow 'volume_create_manager' (2c61f99c-d131-43a8-888c-965570ec95fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:00 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a (73bc9372-2dd8-48eb-93c2-6542d442bc0a): created successfully Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a62d48-c692-41c5-ac18-0d3319b543e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Flow 'volume_create_manager' (7c76c70e-3423-4f1a-9f28-fc458fd483e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:00 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5dbace6e-d03a-447d-a074-aa7a3fdb5044 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Created volume successfully. Sep 25 11:03:00 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d2621659-ee85-4ca8-b502-559659e3a057 tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Created volume successfully. Sep 25 11:03:00 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1c987431-0470-40fa-b0ba-3d66cefebb81" returned: 0 in 0.315s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Lock "cinder-quobyte-1c987431-0470-40fa-b0ba-3d66cefebb81" released by "delete_volume" :: held 0.881s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Created reservations ['4adbaa68-aadd-439d-9b55-5996f8d0d2db', '39e8cea0-00e2-4f0d-8ba9-6b6c83000d2e', '8ea67552-c838-4972-bee3-97befcf71e85', 'e58f5c35-0a1a-4023-a503-14aa5b4f7cf1'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:01 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d580e4f-f6eb-49a2-9270-d528209b3d13 1073741824" returned: 0 in 0.547s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:01 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:01 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Acquiring lock "cinder-8b277349-a331-4446-af9c-1a28932f2b02-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d580e4f-f6eb-49a2-9270-d528209b3d13 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Lock "cinder-8b277349-a331-4446-af9c-1a28932f2b02-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:01 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d580e4f-f6eb-49a2-9270-d528209b3d13 Sep 25 11:03:01 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Acquiring lock "cinder-quobyte-8b277349-a331-4446-af9c-1a28932f2b02" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Lock "cinder-quobyte-8b277349-a331-4446-af9c-1a28932f2b02" acquired by "delete_volume" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06b1073-ae98-44d8-9474-b596cd60fa06]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:01 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.299s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:01 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Deleted volume successfully. Sep 25 11:03:01 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02 Sep 25 11:03:01 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b4ccb671-509f-47df-b4ef-bd1924f0e4f5 tempest-VolumeDependencyTests-847073250 None] Lock "cinder-1c987431-0470-40fa-b0ba-3d66cefebb81-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:01 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d580e4f-f6eb-49a2-9270-d528209b3d13" returned: 0 in 0.304s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.563s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1519472234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e188f9-73e7-4ba9-a063-74a405fcafca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b373014b145d3b12caed689bd7e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:02:52Z,use_quota=True,user_id='e0132ff0d0894d68b96926aa3c4e9743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Creating volume a8e188f9-73e7-4ba9-a063-74a405fcafca {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:01 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a8e188f9-73e7-4ba9-a063-74a405fcafca 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:01 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a8e188f9-73e7-4ba9-a063-74a405fcafca 1073741824 Sep 25 11:03:01 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ae4624-6b2a-438c-9095-269e18b98aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d580e4f-f6eb-49a2-9270-d528209b3d13', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54878f67-4688-42be-991d-1dc65a29d32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:01 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume volume-2d580e4f-f6eb-49a2-9270-d528209b3d13 (2d580e4f-f6eb-49a2-9270-d528209b3d13): created successfully Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54878f67-4688-42be-991d-1dc65a29d32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Flow 'volume_create_manager' (d1b14a1c-fff5-4f6b-a302-bf2d0f88969e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:01 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-35cc210a-4e87-48c0-b567-97eee4daf6e4 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Created volume successfully. Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Acquiring lock "cinder-1f6adb6a-a2b6-4298-8e0c-1499883f1887-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Lock "cinder-1f6adb6a-a2b6-4298-8e0c-1499883f1887-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Acquiring lock "cinder-quobyte-1f6adb6a-a2b6-4298-8e0c-1499883f1887" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:01 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02" returned: 0 in 0.495s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Lock "cinder-quobyte-1f6adb6a-a2b6-4298-8e0c-1499883f1887" acquired by "delete_volume" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:01 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02 Sep 25 11:03:01 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac4bf9c-af2a-4aab-86c1-5c8611d499a0]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:02 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 Sep 25 11:03:02 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:02 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8b277349-a331-4446-af9c-1a28932f2b02" returned: 0 in 0.281s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Lock "cinder-quobyte-8b277349-a331-4446-af9c-1a28932f2b02" released by "delete_volume" :: held 0.836s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:02 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a8e188f9-73e7-4ba9-a063-74a405fcafca 1073741824" returned: 0 in 0.653s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Created reservations ['c668b7cf-d8b6-470a-8314-0e1ff47f01d2', '2c2f8f43-a158-49b9-9a79-9463647d9059', 'be293ad7-f65c-4692-b106-d8323647d7a6', '2d110b19-db9c-4cb5-83af-a84507afc9e1'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a8e188f9-73e7-4ba9-a063-74a405fcafca {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:02 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a8e188f9-73e7-4ba9-a063-74a405fcafca Sep 25 11:03:02 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:02 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887" returned: 0 in 0.435s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:02 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887 Sep 25 11:03:02 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:02 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:02 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:02 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a8e188f9-73e7-4ba9-a063-74a405fcafca" returned: 0 in 0.326s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.105s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b2469b8-e32c-4c7d-8285-d4e4554a0d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e188f9-73e7-4ba9-a063-74a405fcafca', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4886fe0c-b790-46c0-b308-1f7b81e3ebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] Creating offline snapshot d977ffb9-cfc7-4bde-974a-4e3370fe6b21 of volume b0f51f64-c591-4fff-8ef7-52c834d3f038 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:03:02 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Volume volume-a8e188f9-73e7-4ba9-a063-74a405fcafca (a8e188f9-73e7-4ba9-a063-74a405fcafca): created successfully Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4886fe0c-b790-46c0-b308-1f7b81e3ebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:02 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Flow 'volume_create_manager' (55f71597-b26f-4227-bfca-67fcd56c6a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b4a0cd-d110-455a-88f4-bb2ec43c12a5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-1f6adb6a-a2b6-4298-8e0c-1499883f1887" returned: 0 in 0.408s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:02 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.371s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Lock "cinder-quobyte-1f6adb6a-a2b6-4298-8e0c-1499883f1887" released by "delete_volume" :: held 0.909s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:02 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4337d04d-995d-49e4-9e3e-daf5a8405a2b tempest-CreateVolumesFromSnapshotTest-2111881454 None] Created volume successfully. Sep 25 11:03:02 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Deleted volume successfully. Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-c5aa2f7c-145d-4b90-8928-5512108d8989 tempest-VolumeDependencyTests-847073250 None] Lock "cinder-8b277349-a331-4446-af9c-1a28932f2b02-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:02 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Created reservations ['9d8a3f35-c5c8-45a1-8d65-6357a1e00665', '3b79920e-ad76-4139-a3fb-3e902d06028b', '6ed7abc2-6b41-44d7-856c-02f994666ef3', '46561043-a06c-4d78-b4a7-81c6625ccc27'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:02 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 Sep 25 11:03:02 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:03 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:03 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-a8e188f9-73e7-4ba9-a063-74a405fcafca-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-a8e188f9-73e7-4ba9-a063-74a405fcafca-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-quobyte-a8e188f9-73e7-4ba9-a063-74a405fcafca" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-a8e188f9-73e7-4ba9-a063-74a405fcafca" acquired by "delete_volume" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[97977977-f564-4409-a68f-d0a8c711ed84]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a8e188f9-73e7-4ba9-a063-74a405fcafca {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:03 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038" returned: 0 in 0.583s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:03 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 1G Sep 25 11:03:03 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a8e188f9-73e7-4ba9-a063-74a405fcafca Sep 25 11:03:03 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:03 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:03 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.381s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:03 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Deleted volume successfully. Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1b3b512a-c1bd-4a2a-bdb3-149176dd963c tempest-VolumeAndVolumeTypeFromImageTest-581923264 None] Lock "cinder-1f6adb6a-a2b6-4298-8e0c-1499883f1887-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:03 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a8e188f9-73e7-4ba9-a063-74a405fcafca" returned: 0 in 0.476s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a8e188f9-73e7-4ba9-a063-74a405fcafca {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:03 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a8e188f9-73e7-4ba9-a063-74a405fcafca Sep 25 11:03:03 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:03 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 1G" returned: 0 in 0.546s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:03 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 Sep 25 11:03:03 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:04 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a8e188f9-73e7-4ba9-a063-74a405fcafca" returned: 0 in 0.412s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-a8e188f9-73e7-4ba9-a063-74a405fcafca" released by "delete_volume" :: held 0.953s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Created reservations ['adf91df9-348e-48fd-9698-f7a1da810f87', '104a8cd7-4ebb-4c38-8935-5dc7910cbb63', '3d531d76-d08a-442f-bcf8-816b89327f9b', '2b249854-4330-4741-a930-63ec0138bf8c'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:04 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21" returned: 0 in 0.526s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:04 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 is being set with open permissions: ugo+rw Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:04 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 Sep 25 11:03:04 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:04 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:04 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:04 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21" returned: 0 in 0.327s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:04 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.info Sep 25 11:03:04 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:04 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.395s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:04 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Deleted volume successfully. Sep 25 11:03:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-40910c71-9972-438c-9731-554051f50d35 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-a8e188f9-73e7-4ba9-a063-74a405fcafca-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:05 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.info" returned: 0 in 0.337s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:05 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.info is being set with open permissions: ugo+rw Sep 25 11:03:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:05 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.info Sep 25 11:03:05 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-2d580e4f-f6eb-49a2-9270-d528209b3d13-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:05 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.info" returned: 0 in 0.308s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.872s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-2d580e4f-f6eb-49a2-9270-d528209b3d13-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:05 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-90cd6699-f7cb-4996-819a-80622f0578b3 tempest-ProjectMemberTests-1612262589 None] Create snapshot completed successfully Sep 25 11:03:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-quobyte-2d580e4f-f6eb-49a2-9270-d528209b3d13" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-2d580e4f-f6eb-49a2-9270-d528209b3d13" acquired by "delete_volume" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:05 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f744bfaf-1517-4614-891f-99f6515e8939]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d580e4f-f6eb-49a2-9270-d528209b3d13 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:05 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d580e4f-f6eb-49a2-9270-d528209b3d13 Sep 25 11:03:05 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-d977ffb9-cfc7-4bde-974a-4e3370fe6b21-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-d977ffb9-cfc7-4bde-974a-4e3370fe6b21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-b0f51f64-c591-4fff-8ef7-52c834d3f038" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-b0f51f64-c591-4fff-8ef7-52c834d3f038" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-d977ffb9-cfc7-4bde-974a-4e3370fe6b21" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-d977ffb9-cfc7-4bde-974a-4e3370fe6b21" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Deleting offline snapshot d977ffb9-cfc7-4bde-974a-4e3370fe6b21 of volume b0f51f64-c591-4fff-8ef7-52c834d3f038 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] snapshot_file for this snap is: volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[301ccf8e-78b9-492c-b533-d30d9a41817d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:06 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 Sep 25 11:03:06 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:06 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d580e4f-f6eb-49a2-9270-d528209b3d13" returned: 0 in 0.619s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d580e4f-f6eb-49a2-9270-d528209b3d13 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:06 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d580e4f-f6eb-49a2-9270-d528209b3d13 Sep 25 11:03:06 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:06 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-2d580e4f-f6eb-49a2-9270-d528209b3d13" returned: 0 in 0.344s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:06 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-2d580e4f-f6eb-49a2-9270-d528209b3d13" released by "delete_volume" :: held 1.042s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21" returned: 0 in 0.541s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0f51f64-c591-4fff-8ef7-52c834d3f038(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c749be2-874d-49c0-b690-2a28d54d99c3]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Created reservations ['99cf2fb5-abc1-4069-8c6d-f1c38fa87597', 'ff4439b3-817c-485f-9019-06d8d443d48b', '48d7c906-b900-4f85-8e20-734435ad2461', '2d43c302-8c79-4c1a-acbe-433f91d52e78'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:06 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 Sep 25 11:03:06 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Flow 'volume_create_manager' (d60b76f2-c72a-42ac-bf91-83af6490f28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601e807b-3158-4331-9785-301447750bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:07 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:07 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601e807b-3158-4331-9785-301447750bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3dcc588-7696-46d4-8dc8-6236f41ac12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ddd3e8943b448cbda3d4ac3022da49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:07Z,use_quota=True,user_id='bdba59a70d1e4c288e5b3b5975b4108b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d357f7c5-3caa-4724-8ca7-3fe4aca2592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d357f7c5-3caa-4724-8ca7-3fe4aca2592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fb9e80-3eb3-4334-81cb-97b7d0c638a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fb9e80-3eb3-4334-81cb-97b7d0c638a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3dcc588-7696-46d4-8dc8-6236f41ac12b', 'volume_name': 'volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aee7971-3ac4-45c7-9f7e-1c8363bfa1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aee7971-3ac4-45c7-9f7e-1c8363bfa1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c66b558-3191-4c49-a431-ddc574199a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:07 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Volume e3dcc588-7696-46d4-8dc8-6236f41ac12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b', 'volume_size': 1} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3dcc588-7696-46d4-8dc8-6236f41ac12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ddd3e8943b448cbda3d4ac3022da49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:07Z,use_quota=True,user_id='bdba59a70d1e4c288e5b3b5975b4108b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Creating volume e3dcc588-7696-46d4-8dc8-6236f41ac12b {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:07 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:07 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b 1073741824 Sep 25 11:03:07 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:07 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038" returned: 0 in 0.550s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:07 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 Sep 25 11:03:07 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:07 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.416s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:07 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Deleted volume successfully. Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a3bc7da0-5530-4573-931d-d904fca6658a tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-2d580e4f-f6eb-49a2-9270-d528209b3d13-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-73bc9372-2dd8-48eb-93c2-6542d442bc0a-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:07 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21" returned: 0 in 0.520s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:07 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-73bc9372-2dd8-48eb-93c2-6542d442bc0a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b 1073741824" returned: 0 in 0.707s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:07 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21 Sep 25 11:03:07 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-quobyte-73bc9372-2dd8-48eb-93c2-6542d442bc0a" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:07 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-73bc9372-2dd8-48eb-93c2-6542d442bc0a" acquired by "delete_volume" :: waited 0.046s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:07 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b Sep 25 11:03:07 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b46596-5f32-4df6-9a58-9f807a604860]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:08 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a Sep 25 11:03:08 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:08 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038.d977ffb9-cfc7-4bde-974a-4e3370fe6b21" returned: 0 in 0.414s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-d977ffb9-cfc7-4bde-974a-4e3370fe6b21" released by "_delete_snapshot" :: held 2.179s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-b0f51f64-c591-4fff-8ef7-52c834d3f038" released by "delete_snapshot" :: held 2.211s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:08 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b" returned: 0 in 0.360s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c66b558-3191-4c49-a431-ddc574199a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d1d61f-9aff-41df-8f0b-8da05f255ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:08 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Volume volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b (e3dcc588-7696-46d4-8dc8-6236f41ac12b): created successfully Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d1d61f-9aff-41df-8f0b-8da05f255ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Flow 'volume_create_manager' (d60b76f2-c72a-42ac-bf91-83af6490f28c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:08 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-54a17a86-09c2-4e04-9f42-a2bf4cf4e38b tempest-CinderUnicodeTest-846918804 None] Created volume successfully. Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Created reservations ['ebbefa8e-df62-4a1d-b552-b9ef2ccf84ab', 'be7ab1e1-9f73-4fd8-ae53-2eda9664854e', '63bd45f7-e4a9-4930-a186-6643bf9db39d', '656ad568-4b36-4adc-a776-d5affeb913e7'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:08 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Delete snapshot completed successfully. Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-23022f77-4ceb-47b3-89db-5def08216250 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-d977ffb9-cfc7-4bde-974a-4e3370fe6b21-delete_snapshot" released by "delete_snapshot" :: held 2.442s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:08 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a" returned: 0 in 0.471s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:08 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a Sep 25 11:03:08 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:08 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-73bc9372-2dd8-48eb-93c2-6542d442bc0a" returned: 0 in 0.266s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-73bc9372-2dd8-48eb-93c2-6542d442bc0a" released by "delete_volume" :: held 0.811s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Created reservations ['e3719d0b-91a6-4568-93b5-052b3afd9ef5', '0628f417-e9a3-481d-b5f6-d1fa962a0c2c', '42dbebf0-7e6e-4f33-b4ce-016ada3389e9', '8b0d3723-289e-42ee-8661-8e9a407d79bd'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:08 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:08 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-6744fee9-af48-450f-a158-2f3bfe6b8185-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-6744fee9-af48-450f-a158-2f3bfe6b8185-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-quobyte-6744fee9-af48-450f-a158-2f3bfe6b8185" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-6744fee9-af48-450f-a158-2f3bfe6b8185" acquired by "delete_volume" :: waited 0.039s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bea6f7b-13fe-4d28-8c8a-cd693f30c307]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6744fee9-af48-450f-a158-2f3bfe6b8185 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-b0f51f64-c591-4fff-8ef7-52c834d3f038-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-b0f51f64-c591-4fff-8ef7-52c834d3f038-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:09 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6744fee9-af48-450f-a158-2f3bfe6b8185 Sep 25 11:03:09 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-b0f51f64-c591-4fff-8ef7-52c834d3f038" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:09 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.507s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-b0f51f64-c591-4fff-8ef7-52c834d3f038" acquired by "delete_volume" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:09 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Deleted volume successfully. Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1039ef14-6db1-42b0-b2fd-1cf4e04f178d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0133481f-c130-4a01-9306-2e98fd27247c tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-73bc9372-2dd8-48eb-93c2-6542d442bc0a-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:09 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 Sep 25 11:03:09 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:09 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6744fee9-af48-450f-a158-2f3bfe6b8185" returned: 0 in 0.549s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6744fee9-af48-450f-a158-2f3bfe6b8185 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:09 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6744fee9-af48-450f-a158-2f3bfe6b8185 Sep 25 11:03:09 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Flow 'volume_create_manager' (2aea8e03-cbe0-42cb-9f20-48e717ea6d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58e099e-80af-499c-bd38-231dd2ef16a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58e099e-80af-499c-bd38-231dd2ef16a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1811962066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c3bd2b-6166-4113-9f72-7b6385d3b3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ddd3e8943b448cbda3d4ac3022da49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:10Z,use_quota=True,user_id='bdba59a70d1e4c288e5b3b5975b4108b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25406a2-dc02-4e86-8b96-8d97260de835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25406a2-dc02-4e86-8b96-8d97260de835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74043a65-fd70-4f96-a800-c5214d235d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74043a65-fd70-4f96-a800-c5214d235d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c3bd2b-6166-4113-9f72-7b6385d3b3fa', 'volume_name': 'volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5358807-4fc2-4e89-9b2c-c5b3ecd4c873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5358807-4fc2-4e89-9b2c-c5b3ecd4c873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d21875-8bac-4774-9452-304c57315432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:09 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Volume d1c3bd2b-6166-4113-9f72-7b6385d3b3fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa', 'volume_size': 1} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1811962066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c3bd2b-6166-4113-9f72-7b6385d3b3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ddd3e8943b448cbda3d4ac3022da49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:10Z,use_quota=True,user_id='bdba59a70d1e4c288e5b3b5975b4108b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Creating volume d1c3bd2b-6166-4113-9f72-7b6385d3b3fa {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:10 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:10 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038" returned: 0 in 0.499s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:10 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa 1073741824 Sep 25 11:03:10 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:10 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038 Sep 25 11:03:10 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:10 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6744fee9-af48-450f-a158-2f3bfe6b8185" returned: 0 in 0.403s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-6744fee9-af48-450f-a158-2f3bfe6b8185" released by "delete_volume" :: held 1.033s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Created reservations ['1e0c868b-c2f9-48b9-a404-3b022e6b3284', 'ec39491d-1aeb-49fb-9a1a-3855c91d10c5', '9b1a1b9e-0ffb-4566-a2e9-7ee0ec851a2c', '6388bcbe-292e-4116-9445-3ec1ae42d944'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:10 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-b0f51f64-c591-4fff-8ef7-52c834d3f038" returned: 0 in 0.335s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-b0f51f64-c591-4fff-8ef7-52c834d3f038" released by "delete_volume" :: held 0.930s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Created reservations ['a6bbedcf-54b2-4de3-9caf-bff8c4b25105', '1cb0deca-01d6-44ac-8348-cb46666a38cb', 'f64ac7a1-3e18-4a0c-9850-b2a9b37e0f8e', '5ab9a4e3-c543-4f3d-963f-6650fbb11469'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:10 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:10 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:10 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa 1073741824" returned: 0 in 0.595s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:10 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:10 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:10 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa Sep 25 11:03:10 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:10 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.413s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:10 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Deleted volume successfully. Sep 25 11:03:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3c431fff-1d94-464f-98a6-a954879fb7e2 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-6744fee9-af48-450f-a158-2f3bfe6b8185-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:11 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.467s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:11 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Deleted volume successfully. Sep 25 11:03:11 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa" returned: 0 in 0.458s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-34c1ccce-8aec-4c6c-9295-635977243be9 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-b0f51f64-c591-4fff-8ef7-52c834d3f038-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d21875-8bac-4774-9452-304c57315432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0531cb16-5fa4-4613-b7b3-3c98650508da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:11 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Volume volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa (d1c3bd2b-6166-4113-9f72-7b6385d3b3fa): created successfully Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0531cb16-5fa4-4613-b7b3-3c98650508da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Flow 'volume_create_manager' (2aea8e03-cbe0-42cb-9f20-48e717ea6d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Flow 'volume_create_manager' (012dc5d6-62bf-4c12-ac7a-999a20835990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2122038a-da84-423b-805d-145aeeeb6d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2122038a-da84-423b-805d-145aeeeb6d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-631707478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bc1b6d-e365-408b-98f1-b068416ef44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866b78b7ef944d4b9e84bc521a9716e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:11Z,use_quota=True,user_id='327e3cd562ee4cb882d7545b0826d8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22053f2d-d80a-4867-8add-3ed38c216816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22053f2d-d80a-4867-8add-3ed38c216816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c60aac9-f490-4ab3-88c7-3b7a7f3d2481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c60aac9-f490-4ab3-88c7-3b7a7f3d2481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3bc1b6d-e365-408b-98f1-b068416ef44b', 'volume_name': 'volume-a3bc1b6d-e365-408b-98f1-b068416ef44b', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fad810e-6030-4769-babb-e95027d15059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fad810e-6030-4769-babb-e95027d15059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba749e8-8ff3-49c1-a216-4ab720bd58dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:11 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Volume a3bc1b6d-e365-408b-98f1-b068416ef44b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3bc1b6d-e365-408b-98f1-b068416ef44b', 'volume_size': 1} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-631707478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bc1b6d-e365-408b-98f1-b068416ef44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866b78b7ef944d4b9e84bc521a9716e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:11Z,use_quota=True,user_id='327e3cd562ee4cb882d7545b0826d8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Creating volume a3bc1b6d-e365-408b-98f1-b068416ef44b {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:11 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3bc1b6d-e365-408b-98f1-b068416ef44b 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-50a4b7b6-ec19-4e73-b159-457b1b726063-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:11 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3bc1b6d-e365-408b-98f1-b068416ef44b 1073741824 Sep 25 11:03:11 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:11 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-0d209985-4cc9-4cdf-98f0-76312bc53604 tempest-CinderUnicodeTest-846918804 None] Created volume successfully. Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-50a4b7b6-ec19-4e73-b159-457b1b726063-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-quobyte-50a4b7b6-ec19-4e73-b159-457b1b726063" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-50a4b7b6-ec19-4e73-b159-457b1b726063" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1555b01-e539-4471-a2f5-0b7c6ad18538]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-50a4b7b6-ec19-4e73-b159-457b1b726063 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:11 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-50a4b7b6-ec19-4e73-b159-457b1b726063 Sep 25 11:03:11 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Flow 'volume_create_manager' (c17d26e0-ad4a-4773-8e0a-6a3b9b174dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd97d70-997f-459c-afb1-2920c8bb3db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd97d70-997f-459c-afb1-2920c8bb3db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-458854295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43aa5c48-0c56-4d78-b423-723a634e7990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866b78b7ef944d4b9e84bc521a9716e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:12Z,use_quota=True,user_id='327e3cd562ee4cb882d7545b0826d8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90a5d86-4645-457f-8649-6e99e57c9471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90a5d86-4645-457f-8649-6e99e57c9471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c84e2e-aa4d-47a9-936c-887b6d8e5836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c84e2e-aa4d-47a9-936c-887b6d8e5836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43aa5c48-0c56-4d78-b423-723a634e7990', 'volume_name': 'volume-43aa5c48-0c56-4d78-b423-723a634e7990', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98fdd8f-094d-468d-b3aa-5443da2dc7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98fdd8f-094d-468d-b3aa-5443da2dc7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb99d8b-68b7-42f2-ae6f-d9bda141b620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:11 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Volume 43aa5c48-0c56-4d78-b423-723a634e7990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43aa5c48-0c56-4d78-b423-723a634e7990', 'volume_size': 1} Sep 25 11:03:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:12 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3bc1b6d-e365-408b-98f1-b068416ef44b 1073741824" returned: 0 in 0.756s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:12 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-50a4b7b6-ec19-4e73-b159-457b1b726063" returned: 0 in 0.610s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-50a4b7b6-ec19-4e73-b159-457b1b726063 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:12 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-50a4b7b6-ec19-4e73-b159-457b1b726063 Sep 25 11:03:12 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Flow 'volume_create_manager' (c63a29e3-58db-423d-8760-e09377cb96c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be76a1bc-281f-4e72-86e6-78893f73ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3bc1b6d-e365-408b-98f1-b068416ef44b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:12 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3bc1b6d-e365-408b-98f1-b068416ef44b Sep 25 11:03:12 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be76a1bc-281f-4e72-86e6-78893f73ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1915317705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ed499c-0b8d-4c44-81df-1903871e4760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866b78b7ef944d4b9e84bc521a9716e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:12Z,use_quota=True,user_id='327e3cd562ee4cb882d7545b0826d8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1c8fd8-cdd5-4b72-bfd0-7156103fd591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1c8fd8-cdd5-4b72-bfd0-7156103fd591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08bb3a0-8e95-43b0-8cdb-72cf93427ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08bb3a0-8e95-43b0-8cdb-72cf93427ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ed499c-0b8d-4c44-81df-1903871e4760', 'volume_name': 'volume-19ed499c-0b8d-4c44-81df-1903871e4760', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d573331-e75d-4953-89da-710f3c2211a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d573331-e75d-4953-89da-710f3c2211a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c069fe6-f9d2-41d9-ae0d-3d9d27c5ac93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Volume 19ed499c-0b8d-4c44-81df-1903871e4760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ed499c-0b8d-4c44-81df-1903871e4760', 'volume_size': 1} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (248e6bc8-add0-45cb-a721-4c072e81374b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e922afb-03f8-458e-8514-b1b3800cf274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e922afb-03f8-458e-8514-b1b3800cf274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-154100857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db981775-d882-428c-901d-41d59ab7efe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:12Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c08545b-a852-484b-8059-6052db2e6ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c08545b-a852-484b-8059-6052db2e6ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:12 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d8a222-31ba-479c-812a-688f89738a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d8a222-31ba-479c-812a-688f89738a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db981775-d882-428c-901d-41d59ab7efe5', 'volume_name': 'volume-db981775-d882-428c-901d-41d59ab7efe5', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5920d24a-2a08-4cce-a8d8-d547c8049d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5920d24a-2a08-4cce-a8d8-d547c8049d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23090f4-539e-4553-94ae-b27d83b577d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Volume db981775-d882-428c-901d-41d59ab7efe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db981775-d882-428c-901d-41d59ab7efe5', 'volume_size': 1} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-50a4b7b6-ec19-4e73-b159-457b1b726063" returned: 0 in 0.499s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-50a4b7b6-ec19-4e73-b159-457b1b726063" released by "delete_volume" :: held 1.177s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Created reservations ['3622581e-ee7e-4338-a22e-ad0bd3c53eae', '33ae5abb-e5eb-4915-a01d-cc85cfcf6d5f', '02ab7b80-a1d0-432c-8692-e539954add75', 'bb21c30d-a8f5-43e3-a08d-51a536b7004a'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:12 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Flow 'volume_create_manager' (825bebce-6cca-4c9f-b3ec-3bebd7cb675e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e16b23-0b8e-4de2-b679-922721ef8249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3bc1b6d-e365-408b-98f1-b068416ef44b" returned: 0 in 0.613s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.059s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-458854295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43aa5c48-0c56-4d78-b423-723a634e7990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866b78b7ef944d4b9e84bc521a9716e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:12Z,use_quota=True,user_id='327e3cd562ee4cb882d7545b0826d8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Creating volume 43aa5c48-0c56-4d78-b423-723a634e7990 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:12 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-43aa5c48-0c56-4d78-b423-723a634e7990 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:12 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-43aa5c48-0c56-4d78-b423-723a634e7990 1073741824 Sep 25 11:03:12 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e16b23-0b8e-4de2-b679-922721ef8249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-452686229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c54a82-4b42-47b0-829f-a481f5b9ef3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866b78b7ef944d4b9e84bc521a9716e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:13Z,use_quota=True,user_id='327e3cd562ee4cb882d7545b0826d8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f1b265-d56f-4518-9e35-fd65d2f7ebe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f1b265-d56f-4518-9e35-fd65d2f7ebe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41785c5a-9208-4029-b50a-2161ddfd8b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41785c5a-9208-4029-b50a-2161ddfd8b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31c54a82-4b42-47b0-829f-a481f5b9ef3a', 'volume_name': 'volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717963cd-4577-494b-9db4-f90491a9b6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717963cd-4577-494b-9db4-f90491a9b6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394d0a57-f7c7-48ed-a043-892a856b3f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Volume 31c54a82-4b42-47b0-829f-a481f5b9ef3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a', 'volume_size': 1} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba749e8-8ff3-49c1-a216-4ab720bd58dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3bc1b6d-e365-408b-98f1-b068416ef44b', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648bcfed-1dcf-4562-90e2-779ff0dd0e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:12 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Volume volume-a3bc1b6d-e365-408b-98f1-b068416ef44b (a3bc1b6d-e365-408b-98f1-b068416ef44b): created successfully Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648bcfed-1dcf-4562-90e2-779ff0dd0e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Flow 'volume_create_manager' (012dc5d6-62bf-4c12-ac7a-999a20835990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-e9231059-3bd6-4d6b-8370-ad4bc00cc905 tempest-CreateVolumesFromImageTest-656942048 None] Created volume successfully. Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:13 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:13 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Flow 'volume_create_manager' (77cf94cc-9897-43cb-9ae1-033b112d4f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7b3973-e85c-43c6-852e-7aa4f97c46e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7b3973-e85c-43c6-852e-7aa4f97c46e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1007090229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89637d3-91e8-4b85-b810-aac5dec4a1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866b78b7ef944d4b9e84bc521a9716e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:13Z,use_quota=True,user_id='327e3cd562ee4cb882d7545b0826d8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5a5403-d16e-4e10-b861-fc13ac7ba105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5a5403-d16e-4e10-b861-fc13ac7ba105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048506a0-12fa-4025-b079-9dcfc303fb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:13 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048506a0-12fa-4025-b079-9dcfc303fb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89637d3-91e8-4b85-b810-aac5dec4a1f3', 'volume_name': 'volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:13 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef354a73-d520-43ce-a04f-5d7e15106692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef354a73-d520-43ce-a04f-5d7e15106692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4956115c-db57-4b70-b5d4-79eb118bc9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:13 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Volume e89637d3-91e8-4b85-b810-aac5dec4a1f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3', 'volume_size': 1} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-43aa5c48-0c56-4d78-b423-723a634e7990 1073741824" returned: 0 in 0.530s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.339s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Deleted volume successfully. Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-9daef105-0d7d-41a0-a1bf-4e98aa804789 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-50a4b7b6-ec19-4e73-b159-457b1b726063-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-43aa5c48-0c56-4d78-b423-723a634e7990 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:13 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-43aa5c48-0c56-4d78-b423-723a634e7990 Sep 25 11:03:13 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-quobyte-61bd36df-3cdc-4a93-b026-bd943b911d34" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-61bd36df-3cdc-4a93-b026-bd943b911d34" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-quobyte-27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Deleting offline snapshot 27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec of volume 61bd36df-3cdc-4a93-b026-bd943b911d34 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:03:13 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] snapshot_file for this snap is: volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-43aa5c48-0c56-4d78-b423-723a634e7990" returned: 0 in 0.296s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.314s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1915317705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ed499c-0b8d-4c44-81df-1903871e4760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866b78b7ef944d4b9e84bc521a9716e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:12Z,use_quota=True,user_id='327e3cd562ee4cb882d7545b0826d8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Creating volume 19ed499c-0b8d-4c44-81df-1903871e4760 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:13 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19ed499c-0b8d-4c44-81df-1903871e4760 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[956c2af9-53a0-404a-8c84-cfa1b87a5fa5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:13 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19ed499c-0b8d-4c44-81df-1903871e4760 1073741824 Sep 25 11:03:13 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb99d8b-68b7-42f2-ae6f-d9bda141b620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43aa5c48-0c56-4d78-b423-723a634e7990', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3f112e-3c6e-4a77-acc6-2d802f146c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:13 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Volume volume-43aa5c48-0c56-4d78-b423-723a634e7990 (43aa5c48-0c56-4d78-b423-723a634e7990): created successfully Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3f112e-3c6e-4a77-acc6-2d802f146c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Flow 'volume_create_manager' (c17d26e0-ad4a-4773-8e0a-6a3b9b174dfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c31c416d-a183-4d7a-91b9-02bac6135ee3 tempest-CreateVolumesFromImageTest-656942048 None] Created volume successfully. Sep 25 11:03:13 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec Sep 25 11:03:13 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:14 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec" returned: 0 in 0.407s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61bd36df-3cdc-4a93-b026-bd943b911d34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:03:14 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19ed499c-0b8d-4c44-81df-1903871e4760 1073741824" returned: 0 in 0.462s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cc009e-3612-4115-b848-8bde596086c9]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19ed499c-0b8d-4c44-81df-1903871e4760 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:14 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19ed499c-0b8d-4c44-81df-1903871e4760 Sep 25 11:03:14 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:14 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34 Sep 25 11:03:14 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:14 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19ed499c-0b8d-4c44-81df-1903871e4760" returned: 0 in 0.287s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.955s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-154100857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db981775-d882-428c-901d-41d59ab7efe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:12Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Creating volume db981775-d882-428c-901d-41d59ab7efe5 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:14 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:14 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5 1073741824 Sep 25 11:03:14 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c069fe6-f9d2-41d9-ae0d-3d9d27c5ac93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ed499c-0b8d-4c44-81df-1903871e4760', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49064273-d8e8-46b2-a9f2-d4a08fbc5709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:14 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Volume volume-19ed499c-0b8d-4c44-81df-1903871e4760 (19ed499c-0b8d-4c44-81df-1903871e4760): created successfully Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49064273-d8e8-46b2-a9f2-d4a08fbc5709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Flow 'volume_create_manager' (c63a29e3-58db-423d-8760-e09377cb96c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:14 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34" returned: 0 in 0.420s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:14 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-83831096-79a6-4f3c-8369-5334ffc45e43 tempest-CreateVolumesFromImageTest-656942048 None] Created volume successfully. Sep 25 11:03:14 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec Sep 25 11:03:14 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:15 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:15 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5 1073741824" returned: 0 in 0.488s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec" returned: 0 in 0.423s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:15 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec Sep 25 11:03:15 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:15 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5 Sep 25 11:03:15 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:15 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34.27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec" returned: 0 in 0.264s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec" released by "_delete_snapshot" :: held 1.675s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:15 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5" returned: 0 in 0.283s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-61bd36df-3cdc-4a93-b026-bd943b911d34" released by "delete_snapshot" :: held 1.702s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.464s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-452686229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c54a82-4b42-47b0-829f-a481f5b9ef3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866b78b7ef944d4b9e84bc521a9716e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:13Z,use_quota=True,user_id='327e3cd562ee4cb882d7545b0826d8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Creating volume 31c54a82-4b42-47b0-829f-a481f5b9ef3a {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:15 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:15 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a 1073741824 Sep 25 11:03:15 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23090f4-539e-4553-94ae-b27d83b577d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db981775-d882-428c-901d-41d59ab7efe5', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ecb5327-410f-4c40-b92e-4b9e9a34a0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:15 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Volume volume-db981775-d882-428c-901d-41d59ab7efe5 (db981775-d882-428c-901d-41d59ab7efe5): created successfully Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ecb5327-410f-4c40-b92e-4b9e9a34a0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (248e6bc8-add0-45cb-a721-4c072e81374b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:15 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-590a57bb-ac9e-4ca1-baa2-22af29e996ba tempest-ProjectMemberTests-1612262589 None] Created volume successfully. Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Created reservations ['2ea06434-3d7a-4878-917a-508f97ce0ee7', 'a475bf42-350b-413b-abc2-97bd1e5d1629', 'e5425961-01f1-43a2-b97e-5f1878582411', '0ca75d48-76a9-4594-85c9-409231570e8f'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:15 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Delete snapshot completed successfully. Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6eee44c0-1dee-4035-a0f8-8d01a8576837 tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-27a2d6e7-bddd-40f8-a695-a6ecec6cf7ec-delete_snapshot" released by "delete_snapshot" :: held 1.941s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-61bd36df-3cdc-4a93-b026-bd943b911d34-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-61bd36df-3cdc-4a93-b026-bd943b911d34-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "cinder-quobyte-61bd36df-3cdc-4a93-b026-bd943b911d34" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-61bd36df-3cdc-4a93-b026-bd943b911d34" acquired by "delete_volume" :: waited 0.018s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[af13b8e4-3970-46d7-9c8f-95ae87980780]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:16 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a 1073741824" returned: 0 in 0.635s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:16 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34 Sep 25 11:03:16 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:16 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a Sep 25 11:03:16 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:16 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a" returned: 0 in 0.277s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.386s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394d0a57-f7c7-48ed-a043-892a856b3f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:16 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d0f366-5e65-4a81-8133-f73f7d4cdbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] Creating offline snapshot abec0056-7aa7-4ae0-a98f-11daed289e3f of volume d1c3bd2b-6166-4113-9f72-7b6385d3b3fa {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34" returned: 0 in 0.455s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bb9a58-de82-4e33-a44e-e997fb4abaeb]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:16 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34 Sep 25 11:03:16 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:16 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Volume volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a (31c54a82-4b42-47b0-829f-a481f5b9ef3a): created successfully Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d0f366-5e65-4a81-8133-f73f7d4cdbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Flow 'volume_create_manager' (825bebce-6cca-4c9f-b3ec-3bebd7cb675e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4f332b98-f2c1-425d-ab6d-8e0f9e3f0c3c tempest-CreateVolumesFromImageTest-656942048 None] Created volume successfully. Sep 25 11:03:16 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa Sep 25 11:03:16 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:16 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-61bd36df-3cdc-4a93-b026-bd943b911d34" returned: 0 in 0.283s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-quobyte-61bd36df-3cdc-4a93-b026-bd943b911d34" released by "delete_volume" :: held 0.824s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Created reservations ['7266e2b1-537b-4284-822f-298c060080b7', '877eb487-184e-4b77-b868-d5bf18aedf77', '9359fc81-7bfa-467d-a322-d8eb86fbbe2f', '270c3c6f-d411-4271-bb33-81b2736baccd'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:16 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa" returned: 0 in 0.412s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:16 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f 1G Sep 25 11:03:16 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:16 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:16 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:17 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.284s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:17 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:17 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Deleted volume successfully. Sep 25 11:03:17 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-faccea2d-fe50-46b5-b432-34370885065f tempest-CreateVolumesFromSnapshotTest-2111881454 None] Lock "cinder-61bd36df-3cdc-4a93-b026-bd943b911d34-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:17 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f 1G" returned: 0 in 0.503s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:17 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f Sep 25 11:03:17 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:17 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f" returned: 0 in 0.315s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:17 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f is being set with open permissions: ugo+rw Sep 25 11:03:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:17 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f Sep 25 11:03:17 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:17 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f" returned: 0 in 0.283s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:18 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.info Sep 25 11:03:18 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:18 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.info" returned: 0 in 0.275s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:18 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.info is being set with open permissions: ugo+rw Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:18 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.info Sep 25 11:03:18 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:18 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.info" returned: 0 in 0.264s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.175s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1007090229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89637d3-91e8-4b85-b810-aac5dec4a1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866b78b7ef944d4b9e84bc521a9716e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:13Z,use_quota=True,user_id='327e3cd562ee4cb882d7545b0826d8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Creating volume e89637d3-91e8-4b85-b810-aac5dec4a1f3 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:18 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:18 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3 1073741824 Sep 25 11:03:18 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8330c5a1-07a6-49aa-86d3-ca89992506c6 tempest-CinderUnicodeTest-846918804 None] Create snapshot completed successfully Sep 25 11:03:19 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3 1073741824" returned: 0 in 0.508s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:19 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3 Sep 25 11:03:19 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Acquiring lock "cinder-abec0056-7aa7-4ae0-a98f-11daed289e3f-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Lock "cinder-abec0056-7aa7-4ae0-a98f-11daed289e3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Acquiring lock "cinder-quobyte-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Lock "cinder-quobyte-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Acquiring lock "cinder-quobyte-abec0056-7aa7-4ae0-a98f-11daed289e3f" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Lock "cinder-quobyte-abec0056-7aa7-4ae0-a98f-11daed289e3f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Deleting offline snapshot abec0056-7aa7-4ae0-a98f-11daed289e3f of volume d1c3bd2b-6166-4113-9f72-7b6385d3b3fa {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] snapshot_file for this snap is: volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fabf60-884e-40d8-95d8-8a646367af98]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:19 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f Sep 25 11:03:19 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:19 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3" returned: 0 in 0.317s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.667s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4956115c-db57-4b70-b5d4-79eb118bc9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78303543-c3ca-4828-bd5c-c182ebdbc57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] Creating offline snapshot 714601b1-40fc-40e6-a96a-ee2887523815 of volume db981775-d882-428c-901d-41d59ab7efe5 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:03:19 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Volume volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3 (e89637d3-91e8-4b85-b810-aac5dec4a1f3): created successfully Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78303543-c3ca-4828-bd5c-c182ebdbc57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Flow 'volume_create_manager' (77cf94cc-9897-43cb-9ae1-033b112d4f13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[167038fe-5062-4ffa-bd95-a04fbe4df005]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:19 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b7795491-ee85-4a61-9810-5e10fc334ddb tempest-CreateVolumesFromImageTest-656942048 None] Created volume successfully. Sep 25 11:03:19 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5 Sep 25 11:03:19 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:19 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f" returned: 0 in 0.419s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[104a1d7a-2751-4ead-894b-06a27ba34a86]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "cinder-e89637d3-91e8-4b85-b810-aac5dec4a1f3-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-e89637d3-91e8-4b85-b810-aac5dec4a1f3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:20 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa Sep 25 11:03:20 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "cinder-quobyte-e89637d3-91e8-4b85-b810-aac5dec4a1f3" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-quobyte-e89637d3-91e8-4b85-b810-aac5dec4a1f3" acquired by "delete_volume" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ab4776-4220-4ccc-b69d-da408c4254c5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:20 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5" returned: 0 in 0.531s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:20 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 1G Sep 25 11:03:20 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:20 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3 Sep 25 11:03:20 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:20 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa" returned: 0 in 0.583s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:20 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f Sep 25 11:03:20 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Flow 'volume_create_manager' (5e8c73ed-b74a-4c6d-afde-0ad78b7da516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b956a24a-46c8-4cf2-82c2-873ce8bc19b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b956a24a-46c8-4cf2-82c2-873ce8bc19b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1866528928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999b15f7-932f-4099-a142-b1f25cc2d3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5bed78b6a340deb1e3fd246eb57ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:20Z,use_quota=True,user_id='e5d900a570f94fcfa4a4c2b352ea8a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50206dad-6ab7-46cf-982e-f6a23a1f355c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50206dad-6ab7-46cf-982e-f6a23a1f355c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d95597d-5ebe-496f-914e-f62febf6caae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d95597d-5ebe-496f-914e-f62febf6caae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '999b15f7-932f-4099-a142-b1f25cc2d3e7', 'volume_name': 'volume-999b15f7-932f-4099-a142-b1f25cc2d3e7', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5abb383-c9e3-4b29-89e0-85e591089159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5abb383-c9e3-4b29-89e0-85e591089159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5101e22-b0e5-468b-903c-70ce6fb1b592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:20 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume 999b15f7-932f-4099-a142-b1f25cc2d3e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-999b15f7-932f-4099-a142-b1f25cc2d3e7', 'volume_size': 1} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:20 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3" returned: 0 in 0.545s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:20 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 1G" returned: 0 in 0.548s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db981775-d882-428c-901d-41d59ab7efe5 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:20 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3 Sep 25 11:03:20 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:20 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db981775-d882-428c-901d-41d59ab7efe5 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 Sep 25 11:03:20 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:20 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f" returned: 0 in 0.391s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:20 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f Sep 25 11:03:20 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:20 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e89637d3-91e8-4b85-b810-aac5dec4a1f3" returned: 0 in 0.287s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-quobyte-e89637d3-91e8-4b85-b810-aac5dec4a1f3" released by "delete_volume" :: held 0.877s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:20 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db981775-d882-428c-901d-41d59ab7efe5 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815" returned: 0 in 0.320s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:20 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 is being set with open permissions: ugo+rw Sep 25 11:03:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:21 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Created reservations ['41c14874-37aa-4910-99a1-f01251719b6e', 'c29cbcd1-1ca8-41bb-be75-0b954c7ff227', '007f55ed-ec2f-4bb3-a95d-8a779c767df7', 'cb212f67-2546-41d5-ba6c-4d7eba680465'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:21 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:21 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa.abec0056-7aa7-4ae0-a98f-11daed289e3f" returned: 0 in 0.321s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:21 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:21 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Lock "cinder-quobyte-abec0056-7aa7-4ae0-a98f-11daed289e3f" released by "_delete_snapshot" :: held 1.890s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "cinder-31c54a82-4b42-47b0-829f-a481f5b9ef3a-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Lock "cinder-quobyte-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa" released by "delete_snapshot" :: held 1.928s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-31c54a82-4b42-47b0-829f-a481f5b9ef3a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Created reservations ['7858a99d-60d8-4a08-92bf-14d113005561', 'd1587d33-50ca-45b5-a49d-3c81e38e6a4a', '3a87ff58-ade3-4191-81c0-9c9901e52b89', 'f11fe9c9-8c00-4b9b-ae1d-9ef30089010e'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "cinder-quobyte-31c54a82-4b42-47b0-829f-a481f5b9ef3a" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-quobyte-31c54a82-4b42-47b0-829f-a481f5b9ef3a" acquired by "delete_volume" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:21 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8633c70d-b949-4fbc-8803-4bf1bcf724d0]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815" returned: 0 in 0.432s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:21 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Delete snapshot completed successfully. Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-4f329e05-4bda-4cbd-83da-983042d7dd05 tempest-CinderUnicodeTest-846918804 None] Lock "cinder-abec0056-7aa7-4ae0-a98f-11daed289e3f-delete_snapshot" released by "delete_snapshot" :: held 2.233s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:21 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.info Sep 25 11:03:21 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:21 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.391s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:21 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Deleted volume successfully. Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6ad0df0d-fa4c-4f13-82c0-783ce78c76e1 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-e89637d3-91e8-4b85-b810-aac5dec4a1f3-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:21 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a Sep 25 11:03:21 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:21 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.info" returned: 0 in 0.288s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:21 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.info is being set with open permissions: ugo+rw Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:21 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.info Sep 25 11:03:21 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:21 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a" returned: 0 in 0.437s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:21 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a Sep 25 11:03:21 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:21 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.info" returned: 0 in 0.251s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.520s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.439s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1866528928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999b15f7-932f-4099-a142-b1f25cc2d3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5bed78b6a340deb1e3fd246eb57ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:20Z,use_quota=True,user_id='e5d900a570f94fcfa4a4c2b352ea8a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Creating volume 999b15f7-932f-4099-a142-b1f25cc2d3e7 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:22 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-999b15f7-932f-4099-a142-b1f25cc2d3e7 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:22 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-999b15f7-932f-4099-a142-b1f25cc2d3e7 1073741824 Sep 25 11:03:22 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:22 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d53cb5cb-9d9a-4e23-b0e3-b1b6c6cf99d2 tempest-ProjectMemberTests-1612262589 None] Create snapshot completed successfully Sep 25 11:03:22 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-31c54a82-4b42-47b0-829f-a481f5b9ef3a" returned: 0 in 0.268s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-quobyte-31c54a82-4b42-47b0-829f-a481f5b9ef3a" released by "delete_volume" :: held 0.765s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Created reservations ['c61f2782-8a72-4370-ad43-902750f98ba2', '3c5407d7-8e7f-4836-9553-6aa424289436', 'aaa9ead6-1d07-48e7-95c5-70645daf3b3b', 'a3aca509-ec12-44d8-ad4a-19f91a87a9d3'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:22 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:22 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "cinder-19ed499c-0b8d-4c44-81df-1903871e4760-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-19ed499c-0b8d-4c44-81df-1903871e4760-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Acquiring lock "cinder-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Lock "cinder-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "cinder-quobyte-19ed499c-0b8d-4c44-81df-1903871e4760" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:22 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.343s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-quobyte-19ed499c-0b8d-4c44-81df-1903871e4760" acquired by "delete_volume" :: waited 0.046s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:22 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Deleted volume successfully. Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbeba35-df25-4912-9962-dacad78a1620]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19ed499c-0b8d-4c44-81df-1903871e4760 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:22 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Acquiring lock "cinder-quobyte-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-999b15f7-932f-4099-a142-b1f25cc2d3e7 1073741824" returned: 0 in 0.614s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5ef5edf5-f87e-424c-82f8-2ec2b939a9a5 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-31c54a82-4b42-47b0-829f-a481f5b9ef3a-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Lock "cinder-quobyte-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa" acquired by "delete_volume" :: waited 0.041s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddef68c-e26a-430d-b920-74f71fff4f40]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-999b15f7-932f-4099-a142-b1f25cc2d3e7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:22 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19ed499c-0b8d-4c44-81df-1903871e4760 Sep 25 11:03:22 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:22 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-999b15f7-932f-4099-a142-b1f25cc2d3e7 Sep 25 11:03:22 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:22 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa Sep 25 11:03:22 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:23 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-999b15f7-932f-4099-a142-b1f25cc2d3e7" returned: 0 in 0.266s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5101e22-b0e5-468b-903c-70ce6fb1b592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-999b15f7-932f-4099-a142-b1f25cc2d3e7', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2344e440-9ace-43ab-8663-88e867106cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:23 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume volume-999b15f7-932f-4099-a142-b1f25cc2d3e7 (999b15f7-932f-4099-a142-b1f25cc2d3e7): created successfully Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2344e440-9ace-43ab-8663-88e867106cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Flow 'volume_create_manager' (5e8c73ed-b74a-4c6d-afde-0ad78b7da516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:23 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19ed499c-0b8d-4c44-81df-1903871e4760" returned: 0 in 0.458s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19ed499c-0b8d-4c44-81df-1903871e4760 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c6d45335-57db-4c82-b178-ce784d60457b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Created volume successfully. Sep 25 11:03:23 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19ed499c-0b8d-4c44-81df-1903871e4760 Sep 25 11:03:23 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:23 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-714601b1-40fc-40e6-a96a-ee2887523815-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa" returned: 0 in 0.454s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Lock "cinder-714601b1-40fc-40e6-a96a-ee2887523815-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-db981775-d882-428c-901d-41d59ab7efe5" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:23 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa Sep 25 11:03:23 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-db981775-d882-428c-901d-41d59ab7efe5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-714601b1-40fc-40e6-a96a-ee2887523815" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-714601b1-40fc-40e6-a96a-ee2887523815" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Deleting offline snapshot 714601b1-40fc-40e6-a96a-ee2887523815 of volume db981775-d882-428c-901d-41d59ab7efe5 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] snapshot_file for this snap is: volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[720bb370-1c35-4f32-9b6d-63f52c42e554]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:23 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-19ed499c-0b8d-4c44-81df-1903871e4760" returned: 0 in 0.307s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:23 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 Sep 25 11:03:23 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-quobyte-19ed499c-0b8d-4c44-81df-1903871e4760" released by "delete_volume" :: held 0.823s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:23 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa" returned: 0 in 0.279s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Created reservations ['243a9eec-9d0d-4499-93c6-4932ac905549', '9c1f94ed-7bae-4867-a0fa-83ff82a27889', 'e8b5949d-f66a-4e81-bb1b-d126845bad77', '83665709-6c29-4c79-ba7e-23be5d67d4a4'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Lock "cinder-quobyte-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa" released by "delete_volume" :: held 0.802s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Created reservations ['357ceaa8-ea47-4c50-9c94-f1da2942f536', '085cf03a-cd5c-4937-aba1-f95079fa6989', '37495571-6163-4daf-b9ef-e79c131b4eff', '562c6fb7-b88d-408a-a521-c0b39529cab0'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:23 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:23 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:23 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:23 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:23 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815" returned: 0 in 0.486s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db981775-d882-428c-901d-41d59ab7efe5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "cinder-43aa5c48-0c56-4d78-b423-723a634e7990-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a886246-d2f8-4482-a5da-3840dcbcdeac]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-43aa5c48-0c56-4d78-b423-723a634e7990-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:23 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.348s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:23 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Deleted volume successfully. Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "cinder-quobyte-43aa5c48-0c56-4d78-b423-723a634e7990" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:23 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-quobyte-43aa5c48-0c56-4d78-b423-723a634e7990" acquired by "delete_volume" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:23 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5 Sep 25 11:03:23 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8ce91551-31ea-40d3-ace7-5c79d500be96 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-19ed499c-0b8d-4c44-81df-1903871e4760-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6230e215-b0c0-4e62-8428-6051b152f189]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-43aa5c48-0c56-4d78-b423-723a634e7990 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:24 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.450s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:24 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Deleted volume successfully. Sep 25 11:03:24 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-43aa5c48-0c56-4d78-b423-723a634e7990 Sep 25 11:03:24 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-13a9a7cd-7e6e-4b81-99bb-704ef8db8985 tempest-CinderUnicodeTest-846918804 None] Lock "cinder-d1c3bd2b-6166-4113-9f72-7b6385d3b3fa-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:24 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5" returned: 0 in 0.481s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:24 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 Sep 25 11:03:24 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Flow 'volume_create_manager' (cf2b0eb4-c150-4368-a764-441666d24fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bba69e3-eda5-4bbb-b877-6457fa80be39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bba69e3-eda5-4bbb-b877-6457fa80be39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2146566240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03096236-2237-457c-8569-dd993ea4c826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5bed78b6a340deb1e3fd246eb57ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:24Z,use_quota=True,user_id='e5d900a570f94fcfa4a4c2b352ea8a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb22c7c-93f5-40e7-aab9-3acc8ec2322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb22c7c-93f5-40e7-aab9-3acc8ec2322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779da37b-2c09-45dc-8622-1801379a24da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779da37b-2c09-45dc-8622-1801379a24da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03096236-2237-457c-8569-dd993ea4c826', 'volume_name': 'volume-03096236-2237-457c-8569-dd993ea4c826', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e867b4a-a663-401a-a2c7-a29dd92d4442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e867b4a-a663-401a-a2c7-a29dd92d4442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1064e0fd-58e0-4730-bb37-e39bd178efa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:24 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume 03096236-2237-457c-8569-dd993ea4c826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03096236-2237-457c-8569-dd993ea4c826', 'volume_size': 1} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2146566240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03096236-2237-457c-8569-dd993ea4c826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5bed78b6a340deb1e3fd246eb57ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:24Z,use_quota=True,user_id='e5d900a570f94fcfa4a4c2b352ea8a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Creating volume 03096236-2237-457c-8569-dd993ea4c826 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:24 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03096236-2237-457c-8569-dd993ea4c826 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:24 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03096236-2237-457c-8569-dd993ea4c826 1073741824 Sep 25 11:03:24 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:24 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-43aa5c48-0c56-4d78-b423-723a634e7990" returned: 0 in 0.540s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-43aa5c48-0c56-4d78-b423-723a634e7990 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:24 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-43aa5c48-0c56-4d78-b423-723a634e7990 Sep 25 11:03:24 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:24 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815" returned: 0 in 0.501s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:24 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815 Sep 25 11:03:24 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Acquiring lock "cinder-e3dcc588-7696-46d4-8dc8-6236f41ac12b-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Flow 'volume_create_manager' (82e5f3a0-a18f-4e9c-bd41-1803a2449380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dff96ad-c083-4658-b69c-653206d62dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:25 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-43aa5c48-0c56-4d78-b423-723a634e7990" returned: 0 in 0.464s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Lock "cinder-e3dcc588-7696-46d4-8dc8-6236f41ac12b-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dff96ad-c083-4658-b69c-653206d62dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2027744678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57fe4d2c-e759-49b8-b433-4a69f658be4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5bed78b6a340deb1e3fd246eb57ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:25Z,use_quota=True,user_id='e5d900a570f94fcfa4a4c2b352ea8a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29bde919-8b54-47c9-9a60-e7da5699a209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29bde919-8b54-47c9-9a60-e7da5699a209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52f7a79-98aa-4c22-a5f4-ea52e91e670d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52f7a79-98aa-4c22-a5f4-ea52e91e670d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57fe4d2c-e759-49b8-b433-4a69f658be4b', 'volume_name': 'volume-57fe4d2c-e759-49b8-b433-4a69f658be4b', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1fba0e3-1058-436e-bdfc-35cd052372c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1fba0e3-1058-436e-bdfc-35cd052372c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79772ed2-cac3-430e-9e04-1fd3551ba39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:25 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume 57fe4d2c-e759-49b8-b433-4a69f658be4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57fe4d2c-e759-49b8-b433-4a69f658be4b', 'volume_size': 1} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-quobyte-43aa5c48-0c56-4d78-b423-723a634e7990" released by "delete_volume" :: held 1.145s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:25 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5.714601b1-40fc-40e6-a96a-ee2887523815" returned: 0 in 0.344s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Acquiring lock "cinder-quobyte-e3dcc588-7696-46d4-8dc8-6236f41ac12b" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:25 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Lock "cinder-quobyte-e3dcc588-7696-46d4-8dc8-6236f41ac12b" acquired by "delete_volume" :: waited 0.067s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03096236-2237-457c-8569-dd993ea4c826 1073741824" returned: 0 in 0.788s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-714601b1-40fc-40e6-a96a-ee2887523815" released by "_delete_snapshot" :: held 2.041s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-db981775-d882-428c-901d-41d59ab7efe5" released by "delete_snapshot" :: held 2.074s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aa780b-599b-486c-8d48-be2cb3e02a3c]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Created reservations ['79a1b863-8f92-49f2-beee-2f324a1e5195', '03b38bb7-82c3-4e6b-8c29-f47672a6a23c', 'de28b89d-b87f-46f3-98b7-a428b91283e0', '9d7aaef8-0043-449d-a26c-d6de1e0370de'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03096236-2237-457c-8569-dd993ea4c826 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:25 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03096236-2237-457c-8569-dd993ea4c826 Sep 25 11:03:25 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Flow 'volume_create_manager' (c896a0e1-5dba-4439-8c6c-e442e09c06ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d011374-6333-49e0-8a82-1c03f651e161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d011374-6333-49e0-8a82-1c03f651e161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1351339416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b15cfe-cfda-4519-b132-b7951d9c6016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5bed78b6a340deb1e3fd246eb57ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:25Z,use_quota=True,user_id='e5d900a570f94fcfa4a4c2b352ea8a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9eec42-b6a6-4ada-ba99-2cbb7c6bf136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:25 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b Sep 25 11:03:25 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9eec42-b6a6-4ada-ba99-2cbb7c6bf136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b112855-b1fe-4398-907a-3380f3faaf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b112855-b1fe-4398-907a-3380f3faaf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b15cfe-cfda-4519-b132-b7951d9c6016', 'volume_name': 'volume-f4b15cfe-cfda-4519-b132-b7951d9c6016', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf6e6c5-99d9-407f-8bbd-ff3a7c203a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf6e6c5-99d9-407f-8bbd-ff3a7c203a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b917223c-9960-40ae-89b6-35c6d9c1409b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:25 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume f4b15cfe-cfda-4519-b132-b7951d9c6016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b15cfe-cfda-4519-b132-b7951d9c6016', 'volume_size': 1} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Created reservations ['c8dce99c-9899-4871-bda9-8a37aa3e792d', '3bcc528a-eb80-4487-bd09-4a47c893d249', 'a244ce00-830e-4feb-af82-7078b3d24559', '74dbfa63-77c6-4ef1-ac82-4d2e821e4237'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:25 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:25 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:25 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Delete snapshot completed successfully. Sep 25 11:03:25 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03096236-2237-457c-8569-dd993ea4c826" returned: 0 in 0.320s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-75a20c5f-cc66-4713-aa30-d8e547da15ac tempest-ProjectMemberTests-1612262589 None] Lock "cinder-714601b1-40fc-40e6-a96a-ee2887523815-delete_snapshot" released by "delete_snapshot" :: held 2.502s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2027744678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57fe4d2c-e759-49b8-b433-4a69f658be4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5bed78b6a340deb1e3fd246eb57ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:25Z,use_quota=True,user_id='e5d900a570f94fcfa4a4c2b352ea8a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Creating volume 57fe4d2c-e759-49b8-b433-4a69f658be4b {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:25 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-57fe4d2c-e759-49b8-b433-4a69f658be4b 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:25 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-57fe4d2c-e759-49b8-b433-4a69f658be4b 1073741824 Sep 25 11:03:25 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1064e0fd-58e0-4730-bb37-e39bd178efa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03096236-2237-457c-8569-dd993ea4c826', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8fe332-ea61-46b6-80d2-72f2b7417ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:25 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume volume-03096236-2237-457c-8569-dd993ea4c826 (03096236-2237-457c-8569-dd993ea4c826): created successfully Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8fe332-ea61-46b6-80d2-72f2b7417ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Flow 'volume_create_manager' (cf2b0eb4-c150-4368-a764-441666d24fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:25 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f28f43a8-1167-4abd-98c0-6448a5d85b7c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Created volume successfully. Sep 25 11:03:25 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b" returned: 0 in 0.649s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:26 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:26 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b Sep 25 11:03:26 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.438s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:26 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Deleted volume successfully. Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5544f664-b5ed-4999-b446-ca85010d0fc9 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-43aa5c48-0c56-4d78-b423-723a634e7990-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:26 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:26 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Flow 'volume_create_manager' (c78c6077-d3a6-403a-ab61-097df6d5147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae34b40-ead6-4949-ae03-ece0a5e127e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "cinder-a3bc1b6d-e365-408b-98f1-b068416ef44b-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae34b40-ead6-4949-ae03-ece0a5e127e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1572658845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a261afc1-6981-4bee-9466-159954011b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5bed78b6a340deb1e3fd246eb57ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:26Z,use_quota=True,user_id='e5d900a570f94fcfa4a4c2b352ea8a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482da8b5-fe64-4a0b-9dd8-f2b52fe1a8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482da8b5-fe64-4a0b-9dd8-f2b52fe1a8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b6ba9d-18ba-4fcd-828c-1bb6bbb40d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b6ba9d-18ba-4fcd-828c-1bb6bbb40d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a261afc1-6981-4bee-9466-159954011b62', 'volume_name': 'volume-a261afc1-6981-4bee-9466-159954011b62', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d59752b-774d-4f6b-bf86-db2597486e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d59752b-774d-4f6b-bf86-db2597486e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e240bf-8180-44a9-86bc-b72af52de298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:26 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume a261afc1-6981-4bee-9466-159954011b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a261afc1-6981-4bee-9466-159954011b62', 'volume_size': 1} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-a3bc1b6d-e365-408b-98f1-b068416ef44b-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "cinder-quobyte-a3bc1b6d-e365-408b-98f1-b068416ef44b" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:26 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-quobyte-a3bc1b6d-e365-408b-98f1-b068416ef44b" acquired by "delete_volume" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-e3dcc588-7696-46d4-8dc8-6236f41ac12b" returned: 0 in 0.463s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Lock "cinder-quobyte-e3dcc588-7696-46d4-8dc8-6236f41ac12b" released by "delete_volume" :: held 1.200s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0645f6-bf98-413d-abde-861dcce2f9a9]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3bc1b6d-e365-408b-98f1-b068416ef44b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:26 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-57fe4d2c-e759-49b8-b433-4a69f658be4b 1073741824" returned: 0 in 0.766s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-db981775-d882-428c-901d-41d59ab7efe5-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-57fe4d2c-e759-49b8-b433-4a69f658be4b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:26 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:26 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-57fe4d2c-e759-49b8-b433-4a69f658be4b Sep 25 11:03:26 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.534s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-db981775-d882-428c-901d-41d59ab7efe5-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Created reservations ['48e7936b-3065-4bd7-bea2-35b92aa37c86', '94b12dfe-ed87-4f0e-bc5d-00b6e1d1bc07', '2cc45c0a-d129-424c-b2f8-a4befae0a81e', 'beefff91-7ee0-46fb-bc4c-7f9f77e51885'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:03:26 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3bc1b6d-e365-408b-98f1-b068416ef44b Sep 25 11:03:26 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Flow 'volume_create_manager' (32be32e6-b07a-4529-9076-73fab20981c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47257148-e2e8-4989-a134-553099d1a7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-db981775-d882-428c-901d-41d59ab7efe5" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47257148-e2e8-4989-a134-553099d1a7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1361316155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c03d77a-bc7d-4c6a-9c67-4537ac673942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5bed78b6a340deb1e3fd246eb57ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:27Z,use_quota=True,user_id='e5d900a570f94fcfa4a4c2b352ea8a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848d2eb5-7a16-45bb-a6ef-bc2454d88fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848d2eb5-7a16-45bb-a6ef-bc2454d88fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16bf0401-ba0a-4524-a0ea-8abbd3a1e5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16bf0401-ba0a-4524-a0ea-8abbd3a1e5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c03d77a-bc7d-4c6a-9c67-4537ac673942', 'volume_name': 'volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dae1f2f-0365-4618-aaff-40d92996e898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:26 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dae1f2f-0365-4618-aaff-40d92996e898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5467867f-e3ac-4190-8b73-f753bbbb201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:26 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume 3c03d77a-bc7d-4c6a-9c67-4537ac673942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942', 'volume_size': 1} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-57fe4d2c-e759-49b8-b433-4a69f658be4b" returned: 0 in 0.300s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.349s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1351339416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b15cfe-cfda-4519-b132-b7951d9c6016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5bed78b6a340deb1e3fd246eb57ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:25Z,use_quota=True,user_id='e5d900a570f94fcfa4a4c2b352ea8a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Creating volume f4b15cfe-cfda-4519-b132-b7951d9c6016 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:26 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f4b15cfe-cfda-4519-b132-b7951d9c6016 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-db981775-d882-428c-901d-41d59ab7efe5" acquired by "delete_volume" :: waited 0.104s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:26 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f4b15cfe-cfda-4519-b132-b7951d9c6016 1073741824 Sep 25 11:03:26 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79772ed2-cac3-430e-9e04-1fd3551ba39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57fe4d2c-e759-49b8-b433-4a69f658be4b', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb7d702-c0ce-4eb3-9e67-4f82c6a21199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:26 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[93023d0e-9ff5-4a59-be17-0bdf2482357f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:26 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3bc1b6d-e365-408b-98f1-b068416ef44b" returned: 0 in 0.560s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3bc1b6d-e365-408b-98f1-b068416ef44b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:27 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume volume-57fe4d2c-e759-49b8-b433-4a69f658be4b (57fe4d2c-e759-49b8-b433-4a69f658be4b): created successfully Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb7d702-c0ce-4eb3-9e67-4f82c6a21199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Flow 'volume_create_manager' (82e5f3a0-a18f-4e9c-bd41-1803a2449380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:27 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3bc1b6d-e365-408b-98f1-b068416ef44b Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:27 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:27 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8e04472d-d805-43a3-8936-eb1ec1ea16e1 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Created volume successfully. Sep 25 11:03:27 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:27 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:27 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5 Sep 25 11:03:27 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:27 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a3bc1b6d-e365-408b-98f1-b068416ef44b" returned: 0 in 0.377s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-quobyte-a3bc1b6d-e365-408b-98f1-b068416ef44b" released by "delete_volume" :: held 1.016s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:27 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.418s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Created reservations ['be7a8fea-fff7-4216-a5b4-87f25565a22a', 'ab004899-e7d8-49e1-b49a-b81182226939', '90ecb0d1-bb61-41ba-9939-b88dce2586a6', '110d4b6d-7193-422d-b5f5-0b50675c631d'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:27 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Deleted volume successfully. Sep 25 11:03:27 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:27 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f4b15cfe-cfda-4519-b132-b7951d9c6016 1073741824" returned: 0 in 0.609s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cf38923b-2a08-4979-8dcd-d3f7e9a78753 tempest-CinderUnicodeTest-846918804 None] Lock "cinder-e3dcc588-7696-46d4-8dc8-6236f41ac12b-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5" returned: 0 in 0.531s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:27 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5 Sep 25 11:03:27 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f4b15cfe-cfda-4519-b132-b7951d9c6016 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:27 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f4b15cfe-cfda-4519-b132-b7951d9c6016 Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:27 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:27 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:27 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:27 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-db981775-d882-428c-901d-41d59ab7efe5" returned: 0 in 0.318s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-db981775-d882-428c-901d-41d59ab7efe5" released by "delete_volume" :: held 0.951s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Created reservations ['c0923326-e408-4025-80cb-1cde6581074e', '8b06e87f-94ad-4425-bb82-61e1115dcc0e', '1a0e5777-7cde-4b5f-8866-492370a7860a', '54f53e72-c9bb-4f42-b2f2-9f44f9c4d1cc'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:27 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.354s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:27 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:27 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Deleted volume successfully. Sep 25 11:03:27 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f4b15cfe-cfda-4519-b132-b7951d9c6016" returned: 0 in 0.423s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.721s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1572658845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a261afc1-6981-4bee-9466-159954011b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5bed78b6a340deb1e3fd246eb57ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:26Z,use_quota=True,user_id='e5d900a570f94fcfa4a4c2b352ea8a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Creating volume a261afc1-6981-4bee-9466-159954011b62 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:28 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a261afc1-6981-4bee-9466-159954011b62 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:28 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a261afc1-6981-4bee-9466-159954011b62 1073741824 Sep 25 11:03:28 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1107a344-63fe-4399-8dd3-8f339f65add2 tempest-CreateVolumesFromImageTest-656942048 None] Lock "cinder-a3bc1b6d-e365-408b-98f1-b068416ef44b-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b917223c-9960-40ae-89b6-35c6d9c1409b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b15cfe-cfda-4519-b132-b7951d9c6016', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41c5029-8659-4293-98ce-a322b55d1318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:28 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume volume-f4b15cfe-cfda-4519-b132-b7951d9c6016 (f4b15cfe-cfda-4519-b132-b7951d9c6016): created successfully Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41c5029-8659-4293-98ce-a322b55d1318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Flow 'volume_create_manager' (c896a0e1-5dba-4439-8c6c-e442e09c06ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:28 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-19bed092-af13-42e5-8d45-2c781247e51a tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Created volume successfully. Sep 25 11:03:28 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:28 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:28 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.302s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:28 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Deleted volume successfully. Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8ee62f34-55fc-42f6-b716-b18b90d85007 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-db981775-d882-428c-901d-41d59ab7efe5-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:28 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a261afc1-6981-4bee-9466-159954011b62 1073741824" returned: 0 in 0.534s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a261afc1-6981-4bee-9466-159954011b62 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:28 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a261afc1-6981-4bee-9466-159954011b62 Sep 25 11:03:28 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:28 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a261afc1-6981-4bee-9466-159954011b62" returned: 0 in 0.341s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.053s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1361316155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c03d77a-bc7d-4c6a-9c67-4537ac673942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5bed78b6a340deb1e3fd246eb57ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:27Z,use_quota=True,user_id='e5d900a570f94fcfa4a4c2b352ea8a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Creating volume 3c03d77a-bc7d-4c6a-9c67-4537ac673942 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:28 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:29 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942 1073741824 Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e240bf-8180-44a9-86bc-b72af52de298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a261afc1-6981-4bee-9466-159954011b62', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:29 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed6203d-28ca-442e-9829-2d7214fda0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:29 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume volume-a261afc1-6981-4bee-9466-159954011b62 (a261afc1-6981-4bee-9466-159954011b62): created successfully Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed6203d-28ca-442e-9829-2d7214fda0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Flow 'volume_create_manager' (c78c6077-d3a6-403a-ab61-097df6d5147d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:29 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-3291cc5a-44e1-47e8-82c9-f924d7683363 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Created volume successfully. Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (7caa3512-f733-41c7-b74a-e56423e69a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:29 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0438d0ca-2cdd-498f-8f7f-def68d6c7910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942 1073741824" returned: 0 in 0.711s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0438d0ca-2cdd-498f-8f7f-def68d6c7910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1491769356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:30Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bd3786-450c-4777-bc44-fe4e24f9db5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bd3786-450c-4777-bc44-fe4e24f9db5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad8bde8-5c9f-4cc9-ae2a-1af0582a50a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad8bde8-5c9f-4cc9-ae2a-1af0582a50a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b', 'volume_name': 'volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ac3549-b2fd-4e06-9ecd-e1d5aff7b8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ac3549-b2fd-4e06-9ecd-e1d5aff7b8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c6e672-e980-48ac-8f90-21a1167c8b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:29 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Volume 6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b', 'volume_size': 1} Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:29 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942 Sep 25 11:03:29 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:30 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942" returned: 0 in 0.301s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.334s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1491769356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:30Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Creating volume 6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:30 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5467867f-e3ac-4190-8b73-f753bbbb201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c629a09e-c5c6-409c-bb88-4c3f08403617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:30 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b 1073741824 Sep 25 11:03:30 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:30 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Volume volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942 (3c03d77a-bc7d-4c6a-9c67-4537ac673942): created successfully Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c629a09e-c5c6-409c-bb88-4c3f08403617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Flow 'volume_create_manager' (32be32e6-b07a-4529-9076-73fab20981c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:30 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2c3f0ee1-7b84-48ad-a357-fa91cf40a48b tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Created volume successfully. Sep 25 11:03:30 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b 1073741824" returned: 0 in 0.616s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:30 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b Sep 25 11:03:30 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:31 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b" returned: 0 in 0.265s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c6e672-e980-48ac-8f90-21a1167c8b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa50f966-3b18-45a6-8c11-4752be79975f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:31 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Volume volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b (6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b): created successfully Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa50f966-3b18-45a6-8c11-4752be79975f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (7caa3512-f733-41c7-b74a-e56423e69a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:31 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2531c8ab-afa3-41a0-9052-55b2c98303d5 tempest-ProjectMemberTests-1612262589 None] Created volume successfully. Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "cinder-3c03d77a-bc7d-4c6a-9c67-4537ac673942-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-3c03d77a-bc7d-4c6a-9c67-4537ac673942-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "cinder-quobyte-3c03d77a-bc7d-4c6a-9c67-4537ac673942" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-quobyte-3c03d77a-bc7d-4c6a-9c67-4537ac673942" acquired by "delete_volume" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a209c7-dd44-422f-8185-03d634cbec76]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f3afb402-ef50-46b0-b18d-6edbd0916b0e tempest-ProjectAdminTests-1267093837 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4541511535645, 'free_capacity_gb': 1775.4541511535645, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86874) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 11:03:31 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942 Sep 25 11:03:31 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] Creating offline snapshot b3b40f97-b832-4784-99ed-8ec7f6ef855c of volume 6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e83b8b-165d-4768-bd3f-7cdeaf3464bb]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:31 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:32 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942" returned: 0 in 0.543s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:32 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942 Sep 25 11:03:32 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:32 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b Sep 25 11:03:32 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:32 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:32 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3c03d77a-bc7d-4c6a-9c67-4537ac673942" returned: 0 in 0.369s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b" returned: 0 in 0.431s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-quobyte-3c03d77a-bc7d-4c6a-9c67-4537ac673942" released by "delete_volume" :: held 0.987s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:32 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c 1G Sep 25 11:03:32 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Created reservations ['dce1f0a5-1901-4929-8f5a-85cf0883ddec', '6052439a-489f-4b31-957b-e63ea6cba403', 'c0fca5d0-40d1-4f71-8646-4a338b1a2d2b', '9bbeddf8-b46b-46f7-ab62-24ee78ee6e5d'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:32 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:32 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:32 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c 1G" returned: 0 in 0.531s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:32 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:32 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c Sep 25 11:03:32 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:33 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.413s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:33 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:33 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Deleted volume successfully. Sep 25 11:03:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-55700f12-4851-468e-a257-d4581d4af537 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-3c03d77a-bc7d-4c6a-9c67-4537ac673942-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:33 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c" returned: 0 in 0.360s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:33 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c is being set with open permissions: ugo+rw Sep 25 11:03:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:33 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c Sep 25 11:03:33 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:33 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c" returned: 0 in 0.268s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:33 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.info Sep 25 11:03:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "cinder-a261afc1-6981-4bee-9466-159954011b62-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:33 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-a261afc1-6981-4bee-9466-159954011b62-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "cinder-quobyte-a261afc1-6981-4bee-9466-159954011b62" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:33 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-quobyte-a261afc1-6981-4bee-9466-159954011b62" acquired by "delete_volume" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:33 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b99cc6-ac10-4f80-bd2f-07b0631c591e]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:33 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a261afc1-6981-4bee-9466-159954011b62 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:33 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a261afc1-6981-4bee-9466-159954011b62 Sep 25 11:03:33 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:34 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.info" returned: 0 in 0.435s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:34 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.info is being set with open permissions: ugo+rw Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:34 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.info Sep 25 11:03:34 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:34 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a261afc1-6981-4bee-9466-159954011b62" returned: 0 in 0.442s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a261afc1-6981-4bee-9466-159954011b62 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:34 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a261afc1-6981-4bee-9466-159954011b62 Sep 25 11:03:34 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:34 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.info" returned: 0 in 0.322s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.473s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:34 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-fcd6e702-cee2-43d3-ad6b-6d9da299ec84 tempest-ProjectMemberTests-1612262589 None] Create snapshot completed successfully Sep 25 11:03:34 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a261afc1-6981-4bee-9466-159954011b62" returned: 0 in 0.342s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-quobyte-a261afc1-6981-4bee-9466-159954011b62" released by "delete_volume" :: held 0.848s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Created reservations ['47175d78-5d2a-4413-8814-fee81c439a8f', 'a29989db-0ec1-4449-8a69-ceddcb66a711', 'a7fa6150-8b75-45dc-bb34-f4953e0fbb30', '948faff6-7350-4c3e-82b4-c6b1fcf25b28'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:34 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:34 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:34 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "cinder-f4b15cfe-cfda-4519-b132-b7951d9c6016-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-f4b15cfe-cfda-4519-b132-b7951d9c6016-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "cinder-quobyte-f4b15cfe-cfda-4519-b132-b7951d9c6016" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-quobyte-f4b15cfe-cfda-4519-b132-b7951d9c6016" acquired by "delete_volume" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8831d701-5c08-46c4-85c8-a333cfc71c69]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f4b15cfe-cfda-4519-b132-b7951d9c6016 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:35 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.419s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:35 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Deleted volume successfully. Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-b3b40f97-b832-4784-99ed-8ec7f6ef855c-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-74df6376-434b-4e82-8ba3-e35272b6f7d0 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-a261afc1-6981-4bee-9466-159954011b62-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-b3b40f97-b832-4784-99ed-8ec7f6ef855c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-b3b40f97-b832-4784-99ed-8ec7f6ef855c" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-b3b40f97-b832-4784-99ed-8ec7f6ef855c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:35 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f4b15cfe-cfda-4519-b132-b7951d9c6016 Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Deleting offline snapshot b3b40f97-b832-4784-99ed-8ec7f6ef855c of volume 6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:03:35 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] snapshot_file for this snap is: volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa89fb49-0a0f-4afa-85e7-78f9cc8ad55f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:35 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c Sep 25 11:03:35 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:35 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f4b15cfe-cfda-4519-b132-b7951d9c6016" returned: 0 in 0.623s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f4b15cfe-cfda-4519-b132-b7951d9c6016 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:35 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f4b15cfe-cfda-4519-b132-b7951d9c6016 Sep 25 11:03:35 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:35 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Flow 'volume_create_manager' (042d3fb8-5b15-4674-8187-0296ad323959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd268dd-788d-4346-9243-a48dc9d13b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c" returned: 0 in 0.551s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd268dd-788d-4346-9243-a48dc9d13b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0cdcf96-2244-4141-998e-74f12b51703a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ebca77e6044bab963aa3f85b45e0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:36Z,use_quota=True,user_id='25cc7aa35ddc4b7785468b8a336f3773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12de0dab-df40-402b-aa13-81cf2e679209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12de0dab-df40-402b-aa13-81cf2e679209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748ed2f1-df6d-4b26-9b72-4d9be426a798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.image.glance [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Creating Keystone auth plugin from conf {{(pid=86874) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[427c9371-4a2b-4135-a6ba-59859dae1d7c]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:36 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f4b15cfe-cfda-4519-b132-b7951d9c6016" returned: 0 in 0.350s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-quobyte-f4b15cfe-cfda-4519-b132-b7951d9c6016" released by "delete_volume" :: held 1.057s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=195,cinder:UPDATE=289,cinder:INSERT=71,cinder:DELETE=16 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:03:36 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b Sep 25 11:03:36 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Created reservations ['981cc70e-0c57-4d88-acc1-e1cdfda1a4ec', 'ea1ed8dc-c2fa-41b6-98b3-15f0c170658c', '17ec6392-f3c3-49bc-a42c-6d5fd545dbf9', 'b2b59232-6357-4655-9a22-ce6f378a1f5f'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:36 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:36 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:36 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b" returned: 0 in 0.563s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:36 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c Sep 25 11:03:36 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748ed2f1-df6d-4b26-9b72-4d9be426a798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c0cdcf96-2244-4141-998e-74f12b51703a', 'volume_name': 'volume-c0cdcf96-2244-4141-998e-74f12b51703a', 'volume_size': 1, 'image_id': '0cb09768-065a-4a8a-bf36-a2e695bd90a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cb09768-065a-4a8a-bf36-a2e695bd90a8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca59653ecd8771236103f7a9c607baaf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07ebca77e6044bab963aa3f85b45e0fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82109920871e20abb9e2128809dded3213823335faa76892d839e0cb2af296d113e8b11360a0f6802f77d02b3fff91b3741e7a795b0a263c22c273db11af21e1', 'id': '0cb09768-065a-4a8a-bf36-a2e695bd90a8', 'created_at': datetime.datetime(2026, 9, 25, 9, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cb09768-065a-4a8a-bf36-a2e695bd90a8/file', 'properties': {}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0b1e0c-bf54-4151-aecb-b573edc2ab3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0b1e0c-bf54-4151-aecb-b573edc2ab3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2795689c-3044-4213-b5d6-7bcc89ecdfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:36 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Volume c0cdcf96-2244-4141-998e-74f12b51703a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c0cdcf96-2244-4141-998e-74f12b51703a', 'volume_size': 1, 'image_id': '0cb09768-065a-4a8a-bf36-a2e695bd90a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cb09768-065a-4a8a-bf36-a2e695bd90a8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca59653ecd8771236103f7a9c607baaf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07ebca77e6044bab963aa3f85b45e0fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82109920871e20abb9e2128809dded3213823335faa76892d839e0cb2af296d113e8b11360a0f6802f77d02b3fff91b3741e7a795b0a263c22c273db11af21e1', 'id': '0cb09768-065a-4a8a-bf36-a2e695bd90a8', 'created_at': datetime.datetime(2026, 9, 25, 9, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cb09768-065a-4a8a-bf36-a2e695bd90a8/file', 'properties': {}}, 'image_service': } Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Trying to clone c0cdcf96-2244-4141-998e-74f12b51703a from image 0cb09768-065a-4a8a-bf36-a2e695bd90a8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0cb09768-065a-4a8a-bf36-a2e695bd90a8', 'metadata': {}}]). {{(pid=86874) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:03:36 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.363s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:36 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Deleted volume successfully. Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=267,cinder:SELECT=223,cinder:INSERT=74,cinder:DELETE=36 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:03:36 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Image download 0.00 MB at 0.00 MB/s Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b556dfba-938b-46fc-b857-2c588130048c tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-f4b15cfe-cfda-4519-b132-b7951d9c6016-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[411a575f-1f31-497e-8cb2-248eb82053c3]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:37 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD Sep 25 11:03:37 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:37 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c" returned: 0 in 0.439s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:37 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c Sep 25 11:03:37 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "cinder-57fe4d2c-e759-49b8-b433-4a69f658be4b-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:37 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-57fe4d2c-e759-49b8-b433-4a69f658be4b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:37 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b.b3b40f97-b832-4784-99ed-8ec7f6ef855c" returned: 0 in 0.344s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-b3b40f97-b832-4784-99ed-8ec7f6ef855c" released by "_delete_snapshot" :: held 2.093s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b" released by "delete_snapshot" :: held 2.126s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "cinder-quobyte-57fe4d2c-e759-49b8-b433-4a69f658be4b" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-quobyte-57fe4d2c-e759-49b8-b433-4a69f658be4b" acquired by "delete_volume" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:37 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD Sep 25 11:03:37 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef5fb6e-242b-491c-8804-18198680ccf8]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-57fe4d2c-e759-49b8-b433-4a69f658be4b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Created reservations ['9919bc25-2a18-465f-a23f-fa7f7bbc3866', 'f1aeeb5e-60b7-4288-a17c-5441bcc16128', '75010720-98a9-45be-b65d-2fdc43acdb46', '318cfc80-e4c0-43c6-a756-a50436bdcfe1'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:37 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-57fe4d2c-e759-49b8-b433-4a69f658be4b Sep 25 11:03:37 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:37 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Delete snapshot completed successfully. Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d90f1546-2225-4aea-a414-eb3ffe5694a8 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-b3b40f97-b832-4784-99ed-8ec7f6ef855c-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:37 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD" returned: 1 in 0.468s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Temporary image 0cb09768-065a-4a8a-bf36-a2e695bd90a8 is fetched for user 25cc7aa35ddc4b7785468b8a336f3773. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0c1658-a2c0-4e3b-b1ff-e89f039cc481]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:38 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-57fe4d2c-e759-49b8-b433-4a69f658be4b" returned: 0 in 0.514s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-57fe4d2c-e759-49b8-b433-4a69f658be4b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:38 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD Sep 25 11:03:38 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:38 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-57fe4d2c-e759-49b8-b433-4a69f658be4b Sep 25 11:03:38 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:38 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:38 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-57fe4d2c-e759-49b8-b433-4a69f658be4b" returned: 0 in 0.297s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-quobyte-57fe4d2c-e759-49b8-b433-4a69f658be4b" released by "delete_volume" :: held 0.872s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Created reservations ['877fe2bd-8d0b-4cd6-832e-cb2c94cf4da5', 'ee220f76-e785-4f38-8974-44e24a33706d', '12b115b2-3854-4147-be6b-21c5e6de4fbe', '0e883da7-df76-4112-a976-821921499e99'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:38 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD Sep 25 11:03:38 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:38 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:38 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b" acquired by "delete_volume" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f5f632-bbdb-46d1-8500-5c95568cce4f]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:38 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD" returned: 1 in 0.407s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0cdcf96-2244-4141-998e-74f12b51703a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ebca77e6044bab963aa3f85b45e0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:36Z,use_quota=True,user_id='25cc7aa35ddc4b7785468b8a336f3773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Creating volume c0cdcf96-2244-4141-998e-74f12b51703a {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:38 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:38 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a 1073741824 Sep 25 11:03:38 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:38 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b Sep 25 11:03:38 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:38 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.393s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:38 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:38 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Deleted volume successfully. Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d316ae77-5524-41b0-abd1-f5b27ac21b62 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-57fe4d2c-e759-49b8-b433-4a69f658be4b-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:39 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b" returned: 0 in 0.430s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:39 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b Sep 25 11:03:39 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:39 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a 1073741824" returned: 0 in 0.610s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:39 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a Sep 25 11:03:39 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:39 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b" returned: 0 in 0.320s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b" released by "delete_volume" :: held 0.846s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Created reservations ['8f2e14f7-8d42-44bc-a800-2f7b2eabfbf6', '62fe1c86-dc9d-45c0-ad2f-2227d12002fa', '8a4199b4-ac68-4352-98d9-4ee3fbdf1ca2', 'a4516224-3604-41fb-9448-aebe16b1233e'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "cinder-03096236-2237-457c-8569-dd993ea4c826-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-03096236-2237-457c-8569-dd993ea4c826-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "cinder-quobyte-03096236-2237-457c-8569-dd993ea4c826" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:39 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a" returned: 0 in 0.388s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:39 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:39 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-quobyte-03096236-2237-457c-8569-dd993ea4c826" acquired by "delete_volume" :: waited 0.040s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Attempting download of 0cb09768-065a-4a8a-bf36-a2e695bd90a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/0cb09768-065a-4a8a-bf36-a2e695bd90a8', 'metadata': {}}])) to volume c0cdcf96-2244-4141-998e-74f12b51703a. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b47ba08-598e-4c35-8a33-4ff2c8fd8aa8]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03096236-2237-457c-8569-dd993ea4c826 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e700fa58-58b7-4c07-a678-10984dd75b51]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cb09768-065a-4a8a-bf36-a2e695bd90a8_w0x17rg7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:40 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03096236-2237-457c-8569-dd993ea4c826 Sep 25 11:03:40 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:40 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.332s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:40 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Deleted volume successfully. Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-878049ab-b9e2-48cc-9200-cbc857bdacf7 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-6c05cf19-f4f7-4c37-8926-77b7ec2a8e2b-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:40 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cb09768-065a-4a8a-bf36-a2e695bd90a8_w0x17rg7 Sep 25 11:03:40 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:40 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03096236-2237-457c-8569-dd993ea4c826" returned: 0 in 0.578s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03096236-2237-457c-8569-dd993ea4c826 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:40 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cb09768-065a-4a8a-bf36-a2e695bd90a8_w0x17rg7" returned: 0 in 0.515s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cb09768-065a-4a8a-bf36-a2e695bd90a8_w0x17rg7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:40 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03096236-2237-457c-8569-dd993ea4c826 Sep 25 11:03:40 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (f4e67626-9300-4b77-b604-2632a18ed722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a40ee73-2ccc-4111-8ce3-ca8c3ebbf613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:40 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cb09768-065a-4a8a-bf36-a2e695bd90a8_w0x17rg7 Sep 25 11:03:40 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a40ee73-2ccc-4111-8ce3-ca8c3ebbf613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461873908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d37740-bf26-49a8-98a5-4f02cbbafa2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:41Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10183e9-8a80-48d3-821b-6ada63b00d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10183e9-8a80-48d3-821b-6ada63b00d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa12a305-0b61-4e3d-8f3b-4a621607e3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa12a305-0b61-4e3d-8f3b-4a621607e3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82d37740-bf26-49a8-98a5-4f02cbbafa2c', 'volume_name': 'volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774044b3-e5bd-48ed-bb03-228bf4a47d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774044b3-e5bd-48ed-bb03-228bf4a47d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf65d8b-6b63-4c45-819e-fd7609a9082a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:40 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Volume 82d37740-bf26-49a8-98a5-4f02cbbafa2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c', 'volume_size': 1} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461873908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d37740-bf26-49a8-98a5-4f02cbbafa2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:41Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Creating volume 82d37740-bf26-49a8-98a5-4f02cbbafa2c {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:40 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:40 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c 1073741824 Sep 25 11:03:40 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:40 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-03096236-2237-457c-8569-dd993ea4c826" returned: 0 in 0.391s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-quobyte-03096236-2237-457c-8569-dd993ea4c826" released by "delete_volume" :: held 1.041s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:40 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cb09768-065a-4a8a-bf36-a2e695bd90a8_w0x17rg7" returned: 1 in 0.405s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cb09768-065a-4a8a-bf36-a2e695bd90a8_w0x17rg7' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82d57af-0bba-49e7-885e-d7d4d26c135f]: (4, 'raw') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Created reservations ['d3ef74c2-987d-48aa-8f52-d6c5d6348287', '581b733d-e069-453c-99d4-81a7e4230193', 'a51e2100-0db4-44fd-9b5b-31457212bcea', '7b52d11b-df8c-459c-a53d-8394d1e3d88f'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:41 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD Sep 25 11:03:41 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:41 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:41 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:41 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:41 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c 1073741824" returned: 0 in 0.657s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:41 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c Sep 25 11:03:41 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:41 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD Sep 25 11:03:41 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:41 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.386s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:41 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Deleted volume successfully. Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-ae4f7d17-f8db-4cfa-aef8-1e4a522ad3bc tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-03096236-2237-457c-8569-dd993ea4c826-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:41 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c" returned: 0 in 0.292s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf65d8b-6b63-4c45-819e-fd7609a9082a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:41 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d34e5a-8f4f-4578-a1af-38d7b010032c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD" returned: 1 in 0.428s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] 0cb09768-065a-4a8a-bf36-a2e695bd90a8 was raw, converting to qcow2 {{(pid=86874) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:41 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Volume volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c (82d37740-bf26-49a8-98a5-4f02cbbafa2c): created successfully Sep 25 11:03:41 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d34e5a-8f4f-4578-a1af-38d7b010032c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:41 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:41 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (f4e67626-9300-4b77-b604-2632a18ed722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:41 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-36df931e-3bf8-4171-96ea-788051751c40 tempest-ProjectMemberTests-1612262589 None] Created volume successfully. Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "cinder-999b15f7-932f-4099-a142-b1f25cc2d3e7-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-999b15f7-932f-4099-a142-b1f25cc2d3e7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "cinder-quobyte-999b15f7-932f-4099-a142-b1f25cc2d3e7" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-quobyte-999b15f7-932f-4099-a142-b1f25cc2d3e7" acquired by "delete_volume" :: waited 0.021s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2797a7-4f5e-49a7-bfc3-0f5374d24bd6]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-999b15f7-932f-4099-a142-b1f25cc2d3e7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:42 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-999b15f7-932f-4099-a142-b1f25cc2d3e7 Sep 25 11:03:42 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:42 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a" returned: 0 in 0.561s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0cb09768-065a-4a8a-bf36-a2e695bd90a8_ewt7rkzfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:03:42 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:42 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a 1G Sep 25 11:03:42 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:42 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-999b15f7-932f-4099-a142-b1f25cc2d3e7" returned: 0 in 0.445s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-999b15f7-932f-4099-a142-b1f25cc2d3e7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:42 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-999b15f7-932f-4099-a142-b1f25cc2d3e7 Sep 25 11:03:42 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:42 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a 1G" returned: 0 in 0.443s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Downloaded image 0cb09768-065a-4a8a-bf36-a2e695bd90a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/0cb09768-065a-4a8a-bf36-a2e695bd90a8', 'metadata': {}}])) to volume c0cdcf96-2244-4141-998e-74f12b51703a successfully. {{(pid=86874) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Temporary image 0cb09768-065a-4a8a-bf36-a2e695bd90a8 for user 25cc7aa35ddc4b7785468b8a336f3773 is deleted. {{(pid=86874) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG cinder.volume.volume_utils [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Marking volume c0cdcf96-2244-4141-998e-74f12b51703a as bootable. {{(pid=86874) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Copying metadata from image 0cb09768-065a-4a8a-bf36-a2e695bd90a8 to c0cdcf96-2244-4141-998e-74f12b51703a. {{(pid=86874) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Creating volume glance metadata for volume c0cdcf96-2244-4141-998e-74f12b51703a backed by image 0cb09768-065a-4a8a-bf36-a2e695bd90a8 with: {'image_id': '0cb09768-065a-4a8a-bf36-a2e695bd90a8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ca59653ecd8771236103f7a9c607baaf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86874) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:03:42 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-999b15f7-932f-4099-a142-b1f25cc2d3e7" returned: 0 in 0.364s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-quobyte-999b15f7-932f-4099-a142-b1f25cc2d3e7" released by "delete_volume" :: held 0.867s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2795689c-3044-4213-b5d6-7bcc89ecdfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0cdcf96-2244-4141-998e-74f12b51703a', 'volume_size': 1, 'image_id': '0cb09768-065a-4a8a-bf36-a2e695bd90a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cb09768-065a-4a8a-bf36-a2e695bd90a8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca59653ecd8771236103f7a9c607baaf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07ebca77e6044bab963aa3f85b45e0fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82109920871e20abb9e2128809dded3213823335faa76892d839e0cb2af296d113e8b11360a0f6802f77d02b3fff91b3741e7a795b0a263c22c273db11af21e1', 'id': '0cb09768-065a-4a8a-bf36-a2e695bd90a8', 'created_at': datetime.datetime(2026, 9, 25, 9, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cb09768-065a-4a8a-bf36-a2e695bd90a8/file', 'properties': {}}, 'image_service': }' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1676adc-ecb5-4c2d-a1e1-7feb43090a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:43 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Volume volume-c0cdcf96-2244-4141-998e-74f12b51703a (c0cdcf96-2244-4141-998e-74f12b51703a): created successfully Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1676adc-ecb5-4c2d-a1e1-7feb43090a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Flow 'volume_create_manager' (042d3fb8-5b15-4674-8187-0296ad323959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] Creating offline snapshot 43c3da5d-d552-46d7-9e0a-518ff9b54792 of volume 82d37740-bf26-49a8-98a5-4f02cbbafa2c {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:03:43 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-de116cc6-da79-4a48-a899-c5a14712cd0a tempest-VolumeImageDependencyTests-867856757 None] Created volume successfully. Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[76296fde-e8d1-4dae-aeff-b0b9ab025d38]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Created reservations ['a028ea0c-25a9-473c-96a0-fb12accb2f13', '4fe4cf98-8de6-407f-81b8-07384e621079', 'b8e23519-dfe5-487d-9eb4-851d2b8617c6', 'f2501847-4d9c-44dc-9c1b-253bbc19f466'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:43 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:43 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:43 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c Sep 25 11:03:43 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:43 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.283s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:43 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Deleted volume successfully. Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1991f79d-bf5e-43b0-b534-4a7860b25f52 tempest-CreateVolumesFromSourceVolumeTest-1564702879 None] Lock "cinder-999b15f7-932f-4099-a142-b1f25cc2d3e7-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:43 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c" returned: 0 in 0.508s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:43 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 1G Sep 25 11:03:43 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Acquiring lock "cinder-c0cdcf96-2244-4141-998e-74f12b51703a-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Lock "cinder-c0cdcf96-2244-4141-998e-74f12b51703a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Acquiring lock "cinder-quobyte-c0cdcf96-2244-4141-998e-74f12b51703a" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Lock "cinder-quobyte-c0cdcf96-2244-4141-998e-74f12b51703a" acquired by "delete_volume" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2d9cb0-936f-48e4-ae43-c70dcca55c70]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:43 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a Sep 25 11:03:43 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:44 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 1G" returned: 0 in 0.556s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:44 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 Sep 25 11:03:44 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:44 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a" returned: 0 in 0.560s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:44 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a Sep 25 11:03:44 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:44 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792" returned: 0 in 0.436s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:44 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 is being set with open permissions: ugo+rw Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:44 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 Sep 25 11:03:44 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:44 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-c0cdcf96-2244-4141-998e-74f12b51703a" returned: 0 in 0.350s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Lock "cinder-quobyte-c0cdcf96-2244-4141-998e-74f12b51703a" released by "delete_volume" :: held 0.972s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Created reservations ['0203be94-8c31-4f4b-a17d-c32ce2d847fd', 'ac613286-4a61-4653-8c61-fa56dbc7641f', 'c272e27f-8bbb-4a12-80d6-3626492fdbef', '091e00fd-8efa-4a7b-99ca-5489694d95c6'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:44 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792" returned: 0 in 0.402s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:45 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:45 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:45 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.info Sep 25 11:03:45 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:45 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.354s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:45 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:45 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Deleted volume successfully. Sep 25 11:03:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-3aaf365a-1c88-4777-8422-d1df3b0425ab tempest-VolumeImageDependencyTests-867856757 None] Lock "cinder-c0cdcf96-2244-4141-998e-74f12b51703a-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:45 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.info" returned: 0 in 0.363s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:45 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.info is being set with open permissions: ugo+rw Sep 25 11:03:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:45 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.info Sep 25 11:03:45 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:45 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.info" returned: 0 in 0.328s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.736s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:45 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-af37d572-69db-4c61-ad01-2c6605f38083 tempest-ProjectMemberTests-1612262589 None] Create snapshot completed successfully Sep 25 11:03:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-43c3da5d-d552-46d7-9e0a-518ff9b54792-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Lock "cinder-43c3da5d-d552-46d7-9e0a-518ff9b54792-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-82d37740-bf26-49a8-98a5-4f02cbbafa2c" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-82d37740-bf26-49a8-98a5-4f02cbbafa2c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-43c3da5d-d552-46d7-9e0a-518ff9b54792" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-43c3da5d-d552-46d7-9e0a-518ff9b54792" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Deleting offline snapshot 43c3da5d-d552-46d7-9e0a-518ff9b54792 of volume 82d37740-bf26-49a8-98a5-4f02cbbafa2c {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:03:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] snapshot_file for this snap is: volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:03:46 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2905e46b-a70c-402b-9e4f-39bb006917c1]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:46 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 Sep 25 11:03:46 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:46 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792" returned: 0 in 0.496s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:03:46 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[95226653-c715-4edb-8dc9-a16274ee4d61]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:46 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c Sep 25 11:03:46 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:47 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c" returned: 0 in 0.531s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:47 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 Sep 25 11:03:47 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:47 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792" returned: 0 in 0.489s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:47 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792 Sep 25 11:03:47 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:48 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c.43c3da5d-d552-46d7-9e0a-518ff9b54792" returned: 0 in 0.353s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-43c3da5d-d552-46d7-9e0a-518ff9b54792" released by "_delete_snapshot" :: held 2.046s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-82d37740-bf26-49a8-98a5-4f02cbbafa2c" released by "delete_snapshot" :: held 2.076s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Created reservations ['f47db531-10ab-4f5e-9bf6-f2cb17fbdf1f', 'd8b4e8b7-c7df-4c3c-9f61-e3a95d5d9e72', 'f0f333b0-c9d8-40ce-8d7c-2060a597ff9b', '2daa82f5-c211-4cbf-9733-47613775cf7e'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:48 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Delete snapshot completed successfully. Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-d2f5633b-ba82-441f-8811-7b9e57dbb8fb tempest-ProjectMemberTests-1612262589 None] Lock "cinder-43c3da5d-d552-46d7-9e0a-518ff9b54792-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Flow 'volume_create_manager' (d9733f83-c120-4ddc-b5aa-fc6a81a2076d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e3930c-513a-4211-92c6-bd66d09aa198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e3930c-513a-4211-92c6-bd66d09aa198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511827021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10aada60-7975-42be-8b9b-1ccb29054173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98280761ffd04760925066e38f38095c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:48Z,use_quota=True,user_id='52e3dd3d5f724267bf601d6299ffb524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0698d826-69fa-4fa0-88af-dc5208b17499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0698d826-69fa-4fa0-88af-dc5208b17499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab15ff90-b075-4072-86ab-346ef67fb539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab15ff90-b075-4072-86ab-346ef67fb539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10aada60-7975-42be-8b9b-1ccb29054173', 'volume_name': 'volume-10aada60-7975-42be-8b9b-1ccb29054173', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534d206d-6482-4d8a-92b1-ed0cfb47ecf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534d206d-6482-4d8a-92b1-ed0cfb47ecf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362d904e-b764-40e1-99b3-e221eddf4b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:48 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Volume 10aada60-7975-42be-8b9b-1ccb29054173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10aada60-7975-42be-8b9b-1ccb29054173', 'volume_size': 1} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511827021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10aada60-7975-42be-8b9b-1ccb29054173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98280761ffd04760925066e38f38095c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:48Z,use_quota=True,user_id='52e3dd3d5f724267bf601d6299ffb524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Creating volume 10aada60-7975-42be-8b9b-1ccb29054173 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:48 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-10aada60-7975-42be-8b9b-1ccb29054173 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:48 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-10aada60-7975-42be-8b9b-1ccb29054173 1073741824 Sep 25 11:03:48 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:49 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-10aada60-7975-42be-8b9b-1ccb29054173 1073741824" returned: 0 in 0.542s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-10aada60-7975-42be-8b9b-1ccb29054173 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:49 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-10aada60-7975-42be-8b9b-1ccb29054173 Sep 25 11:03:49 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-82d37740-bf26-49a8-98a5-4f02cbbafa2c-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Lock "cinder-82d37740-bf26-49a8-98a5-4f02cbbafa2c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-82d37740-bf26-49a8-98a5-4f02cbbafa2c" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-82d37740-bf26-49a8-98a5-4f02cbbafa2c" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dfe1f1-52b2-4198-b08e-339f7a3108e8]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:49 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-10aada60-7975-42be-8b9b-1ccb29054173" returned: 0 in 0.371s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362d904e-b764-40e1-99b3-e221eddf4b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10aada60-7975-42be-8b9b-1ccb29054173', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e45a7d4-7323-495a-9d40-e8e0889b2880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:49 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Volume volume-10aada60-7975-42be-8b9b-1ccb29054173 (10aada60-7975-42be-8b9b-1ccb29054173): created successfully Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e45a7d4-7323-495a-9d40-e8e0889b2880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:49 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Flow 'volume_create_manager' (d9733f83-c120-4ddc-b5aa-fc6a81a2076d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:49 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-db6bdc7c-e067-44cb-9583-9bfb78c4c575 tempest-ProjectReaderTests-1448943636 None] Created volume successfully. Sep 25 11:03:49 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c Sep 25 11:03:49 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:50 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c" returned: 0 in 0.436s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:50 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c Sep 25 11:03:50 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:50 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-82d37740-bf26-49a8-98a5-4f02cbbafa2c" returned: 0 in 0.283s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-82d37740-bf26-49a8-98a5-4f02cbbafa2c" released by "delete_volume" :: held 0.806s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:50 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Created reservations ['edf5a60d-207e-4a31-b26e-7d653615869a', 'c434fc9c-71d2-49ee-bc4f-cf8ed52a8af5', 'e9bd4443-c4d2-4c2c-b80a-5f4c45fe61a1', 'c9129c80-0b38-4147-af73-2cc91612f0eb'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:50 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:50 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:50 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.469s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:50 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:50 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Deleted volume successfully. Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-906578cc-a5c1-4988-912a-ea43b55c661e tempest-ProjectMemberTests-1612262589 None] Lock "cinder-82d37740-bf26-49a8-98a5-4f02cbbafa2c-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Acquiring lock "cinder-10aada60-7975-42be-8b9b-1ccb29054173-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (5a934a63-305d-414c-bfe5-b86118c65c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715329e0-c33f-477d-8963-8143f5467515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Lock "cinder-10aada60-7975-42be-8b9b-1ccb29054173-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715329e0-c33f-477d-8963-8143f5467515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1602769492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcee3845-a43d-4b2f-8157-573a5dd9d2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:51Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6409135-152c-4427-8148-caeefbcbcdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6409135-152c-4427-8148-caeefbcbcdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006a5270-f342-4c74-b9e8-5a563e0a07f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006a5270-f342-4c74-b9e8-5a563e0a07f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcee3845-a43d-4b2f-8157-573a5dd9d2d3', 'volume_name': 'volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2949c66f-19ed-47a6-b556-ace6273a97c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2949c66f-19ed-47a6-b556-ace6273a97c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa093b2-777a-4aed-af2a-1a15812d03b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:51 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Volume dcee3845-a43d-4b2f-8157-573a5dd9d2d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3', 'volume_size': 1} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1602769492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcee3845-a43d-4b2f-8157-573a5dd9d2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:51Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Creating volume dcee3845-a43d-4b2f-8157-573a5dd9d2d3 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:51 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Acquiring lock "cinder-quobyte-10aada60-7975-42be-8b9b-1ccb29054173" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:51 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 1073741824 Sep 25 11:03:51 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Lock "cinder-quobyte-10aada60-7975-42be-8b9b-1ccb29054173" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b788b46f-a5bc-4367-ac04-e99eccf2d442]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-10aada60-7975-42be-8b9b-1ccb29054173 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:51 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-10aada60-7975-42be-8b9b-1ccb29054173 Sep 25 11:03:51 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:52 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-10aada60-7975-42be-8b9b-1ccb29054173" returned: 0 in 0.545s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-10aada60-7975-42be-8b9b-1ccb29054173 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:52 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-10aada60-7975-42be-8b9b-1ccb29054173 Sep 25 11:03:52 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Flow 'volume_create_manager' (4779c448-0569-46f0-85c0-8256a9de3e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e540c7-6463-4024-a0c9-99fb515be1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:52 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e540c7-6463-4024-a0c9-99fb515be1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1941759319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5815b3c1-050c-4012-ab03-8ea5cf96b864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc760b9e55140aca9ee821d0a06d9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:52Z,use_quota=True,user_id='b1e4775c380f4be59076858366e912bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca66121a-244f-457d-a6f5-08941b7f905e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca66121a-244f-457d-a6f5-08941b7f905e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4ae493-a7c4-4971-b214-4d2b38eacdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4ae493-a7c4-4971-b214-4d2b38eacdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5815b3c1-050c-4012-ab03-8ea5cf96b864', 'volume_name': 'volume-5815b3c1-050c-4012-ab03-8ea5cf96b864', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f11ebb-bae6-4462-bf81-bcf825834408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f11ebb-bae6-4462-bf81-bcf825834408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e596018-a660-49cb-960f-7abf999fd18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:52 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Volume 5815b3c1-050c-4012-ab03-8ea5cf96b864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5815b3c1-050c-4012-ab03-8ea5cf96b864', 'volume_size': 1} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 1073741824" returned: 0 in 0.795s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:52 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 Sep 25 11:03:52 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:52 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-10aada60-7975-42be-8b9b-1ccb29054173" returned: 0 in 0.382s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Lock "cinder-quobyte-10aada60-7975-42be-8b9b-1ccb29054173" released by "delete_volume" :: held 1.005s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:52 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3" returned: 0 in 0.318s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1941759319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5815b3c1-050c-4012-ab03-8ea5cf96b864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc760b9e55140aca9ee821d0a06d9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:52Z,use_quota=True,user_id='b1e4775c380f4be59076858366e912bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Creating volume 5815b3c1-050c-4012-ab03-8ea5cf96b864 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:52 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Created reservations ['df42001d-25fd-4cf0-a072-c4529be7c2fc', 'a46ccf4e-4a0a-4d39-8680-5bcdc57cd5e0', '3f479dc7-b4a1-4f26-9b09-82242e806170', '532a25ae-c82d-41ed-afdd-88ba5a1ec6ce'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:52 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 1073741824 Sep 25 11:03:52 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa093b2-777a-4aed-af2a-1a15812d03b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e564db8c-74ef-4c28-9fc0-db24f0da1e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:52 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Volume volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 (dcee3845-a43d-4b2f-8157-573a5dd9d2d3): created successfully Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e564db8c-74ef-4c28-9fc0-db24f0da1e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (5a934a63-305d-414c-bfe5-b86118c65c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:52 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-aea554c4-4f85-4957-9e50-700378aac038 tempest-ProjectMemberTests-1612262589 None] Created volume successfully. Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:52 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:52 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:53 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.317s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:03:53 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Deleted volume successfully. Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-da1c6407-0704-46f0-9463-26dd0b478751 tempest-ProjectReaderTests-1448943636 None] Lock "cinder-10aada60-7975-42be-8b9b-1ccb29054173-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:53 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 1073741824" returned: 0 in 0.581s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:53 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 Sep 25 11:03:53 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:53 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864" returned: 0 in 0.283s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e596018-a660-49cb-960f-7abf999fd18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5815b3c1-050c-4012-ab03-8ea5cf96b864', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49851107-b120-4da3-a2c5-d3dc6fe23b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:53 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Volume volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 (5815b3c1-050c-4012-ab03-8ea5cf96b864): created successfully Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49851107-b120-4da3-a2c5-d3dc6fe23b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Flow 'volume_create_manager' (4779c448-0569-46f0-85c0-8256a9de3e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:53 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-ae384769-b2c4-4097-bb3d-878693433dc7 tempest-ProjectReaderTests-330771959 None] Created volume successfully. Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] Creating offline snapshot 6a0bec94-6390-41cb-8a0f-03cf3a877ba8 of volume dcee3845-a43d-4b2f-8157-573a5dd9d2d3 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b283f1-3260-4dd1-aa2f-34cd1152ae71]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:53 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 Sep 25 11:03:53 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:54 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3" returned: 0 in 0.561s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:54 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 1G Sep 25 11:03:54 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Flow 'volume_create_manager' (2fc98cae-c62e-4a15-bc48-ad78e49bcb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aba3737-f4df-4d02-a1c7-e7e3b520c83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aba3737-f4df-4d02-a1c7-e7e3b520c83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1465631038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015ee266-256a-4ed1-91c1-0d83e8a5bc99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98280761ffd04760925066e38f38095c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:54Z,use_quota=True,user_id='52e3dd3d5f724267bf601d6299ffb524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3887e22e-027d-4993-a8cc-bd413a92eb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3887e22e-027d-4993-a8cc-bd413a92eb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405ba3e9-9cf6-45a1-b572-f0d8883346d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405ba3e9-9cf6-45a1-b572-f0d8883346d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '015ee266-256a-4ed1-91c1-0d83e8a5bc99', 'volume_name': 'volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f177450b-2250-421e-96d8-b763e9c46560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f177450b-2250-421e-96d8-b763e9c46560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0984c87-2b71-425f-88de-12d3ab987b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:54 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Volume 015ee266-256a-4ed1-91c1-0d83e8a5bc99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99', 'volume_size': 1} Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:54 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 1G" returned: 0 in 0.682s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:54 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 Sep 25 11:03:54 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:55 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8" returned: 0 in 0.384s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:55 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 is being set with open permissions: ugo+rw Sep 25 11:03:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:55 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 Sep 25 11:03:55 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:55 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8" returned: 0 in 0.311s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:55 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.info Sep 25 11:03:55 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:55 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.info" returned: 0 in 0.281s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:55 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.info is being set with open permissions: ugo+rw Sep 25 11:03:55 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:55 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.info Sep 25 11:03:55 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:56 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.info" returned: 0 in 0.279s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.789s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1465631038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015ee266-256a-4ed1-91c1-0d83e8a5bc99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98280761ffd04760925066e38f38095c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:03:54Z,use_quota=True,user_id='52e3dd3d5f724267bf601d6299ffb524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Creating volume 015ee266-256a-4ed1-91c1-0d83e8a5bc99 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:03:56 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:56 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99 1073741824 Sep 25 11:03:56 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:56 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8b687e56-9469-4a12-bdc2-4f7945bbf0cb tempest-ProjectMemberTests-1612262589 None] Create snapshot completed successfully Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-6a0bec94-6390-41cb-8a0f-03cf3a877ba8-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:56 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99 1073741824" returned: 0 in 0.603s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-6a0bec94-6390-41cb-8a0f-03cf3a877ba8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-dcee3845-a43d-4b2f-8157-573a5dd9d2d3" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-dcee3845-a43d-4b2f-8157-573a5dd9d2d3" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-6a0bec94-6390-41cb-8a0f-03cf3a877ba8" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:56 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-6a0bec94-6390-41cb-8a0f-03cf3a877ba8" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Deleting offline snapshot 6a0bec94-6390-41cb-8a0f-03cf3a877ba8 of volume dcee3845-a43d-4b2f-8157-573a5dd9d2d3 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:03:57 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99 Sep 25 11:03:57 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] snapshot_file for this snap is: volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec098d9-0590-4b5e-b609-7b558c7f2ab9]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:57 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 Sep 25 11:03:57 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:57 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99" returned: 0 in 0.466s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.812s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] Creating offline snapshot 125c5ed6-22d0-4246-820e-7758d64fa52e of volume 5815b3c1-050c-4012-ab03-8ea5cf96b864 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0984c87-2b71-425f-88de-12d3ab987b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6133cb1-efcf-4ba2-b4a9-fcff242bd787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3c672a-7cdf-4471-8e85-c3f9b6d2fbb0]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:57 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Volume volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99 (015ee266-256a-4ed1-91c1-0d83e8a5bc99): created successfully Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6133cb1-efcf-4ba2-b4a9-fcff242bd787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Flow 'volume_create_manager' (2fc98cae-c62e-4a15-bc48-ad78e49bcb1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:03:57 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-25b1eb06-ccec-455d-9991-9d7d7dca8bc2 tempest-ProjectReaderTests-1448943636 None] Created volume successfully. Sep 25 11:03:57 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8" returned: 0 in 0.535s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:03:57 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 Sep 25 11:03:57 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdd1b1b-eec5-48c4-a923-e587ee400e5a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:57 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 Sep 25 11:03:57 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:57 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864" returned: 0 in 0.485s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:57 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:58 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e 1G Sep 25 11:03:58 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:58 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3" returned: 0 in 0.502s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:58 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 Sep 25 11:03:58 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:58 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e 1G" returned: 0 in 0.524s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:58 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e Sep 25 11:03:58 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:58 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Acquiring lock "cinder-015ee266-256a-4ed1-91c1-0d83e8a5bc99-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8" returned: 0 in 0.469s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Lock "cinder-015ee266-256a-4ed1-91c1-0d83e8a5bc99-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:58 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8 Sep 25 11:03:58 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Acquiring lock "cinder-quobyte-015ee266-256a-4ed1-91c1-0d83e8a5bc99" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:03:58 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Lock "cinder-quobyte-015ee266-256a-4ed1-91c1-0d83e8a5bc99" acquired by "delete_volume" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:03:58 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f136e493-38a9-47d3-bea4-88d9060cc69a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:03:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:58 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e" returned: 0 in 0.425s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:58 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e is being set with open permissions: ugo+rw Sep 25 11:03:58 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:58 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99 Sep 25 11:03:58 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:58 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e Sep 25 11:03:58 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:59 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3.6a0bec94-6390-41cb-8a0f-03cf3a877ba8" returned: 0 in 0.408s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-6a0bec94-6390-41cb-8a0f-03cf3a877ba8" released by "_delete_snapshot" :: held 2.122s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-dcee3845-a43d-4b2f-8157-573a5dd9d2d3" released by "delete_snapshot" :: held 2.180s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:59 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e" returned: 0 in 0.317s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Created reservations ['bddfee8e-d6c4-4831-9e7c-e4df9f2c76e4', '40727378-b528-4cbe-bb56-d8e2173555f3', '681efa22-2551-44bd-aae7-e84fdcf6e740', 'e2607ca6-0a18-4143-9f28-1b51cbde5844'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:59 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99" returned: 0 in 0.505s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:59 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.info Sep 25 11:03:59 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:59 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99 Sep 25 11:03:59 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:59 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Delete snapshot completed successfully. Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7187c481-fdec-4489-802a-db3b20ac0f43 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-6a0bec94-6390-41cb-8a0f-03cf3a877ba8-delete_snapshot" released by "delete_snapshot" :: held 2.458s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:59 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.info" returned: 0 in 0.283s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:59 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.info is being set with open permissions: ugo+rw Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:59 devstack sudo[108898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.info Sep 25 11:03:59 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:59 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-015ee266-256a-4ed1-91c1-0d83e8a5bc99" returned: 0 in 0.302s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Lock "cinder-quobyte-015ee266-256a-4ed1-91c1-0d83e8a5bc99" released by "delete_volume" :: held 0.868s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Created reservations ['d66aa471-d432-470c-84e1-a5393e63927f', '2747c009-2a70-4406-9d3c-45917a23a5c7', 'e04d822d-07f2-413e-86a5-338775631015', 'b3dbaab3-954f-494a-a9f6-03fe63045a4b'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:03:59 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:03:59 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:03:59 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.info" returned: 0 in 0.352s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:03:59 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.509s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:03:59 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-806c713d-b397-4eaa-b043-87a41eb1f319 tempest-ProjectReaderTests-330771959 None] Create snapshot completed successfully Sep 25 11:04:00 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.374s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:00 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:00 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Deleted volume successfully. Sep 25 11:04:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-dcee3845-a43d-4b2f-8157-573a5dd9d2d3-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Lock "cinder-dcee3845-a43d-4b2f-8157-573a5dd9d2d3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7a196579-e616-4d7a-b8ac-6e285f2e689e tempest-ProjectReaderTests-1448943636 None] Lock "cinder-015ee266-256a-4ed1-91c1-0d83e8a5bc99-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-dcee3845-a43d-4b2f-8157-573a5dd9d2d3" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:00 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-dcee3845-a43d-4b2f-8157-573a5dd9d2d3" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:00 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbd33ff-439a-40d3-8728-0f860c7c0998]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:00 devstack sudo[108904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 Sep 25 11:04:00 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:00 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3" returned: 0 in 0.438s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:00 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:00 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3 Sep 25 11:04:00 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:01 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-dcee3845-a43d-4b2f-8157-573a5dd9d2d3" returned: 0 in 0.363s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-dcee3845-a43d-4b2f-8157-573a5dd9d2d3" released by "delete_volume" :: held 0.909s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Created reservations ['62244a5c-d9f5-4f70-a2c3-ccfe80e61ed5', 'd87f602a-9788-40ea-9a4b-a744f6f1adb3', '8d9e7cb1-4529-4067-9792-e01c7c8b7dff', 'acf00bc2-3211-43c3-97a4-cafed64e9c65'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-125c5ed6-22d0-4246-820e-7758d64fa52e-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Lock "cinder-125c5ed6-22d0-4246-820e-7758d64fa52e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.091s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-5815b3c1-050c-4012-ab03-8ea5cf96b864" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:01 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:01 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Flow 'volume_create_manager' (4035dd59-c452-46cd-ab8b-f322903ee607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17d2c7a-e731-4914-b607-36b18936c233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17d2c7a-e731-4914-b607-36b18936c233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1447392976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2541690-4077-46e1-bf24-3e918961d8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8fee1efb4497f8430a0ba25aa3f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:02Z,use_quota=True,user_id='e9dc13a8f52d4fa585ec1b37cc9c3d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af7f25e-c665-41d1-8c38-4218f3be8774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af7f25e-c665-41d1-8c38-4218f3be8774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c5abe6-ccd0-4fe7-b026-4cd5c01d8c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c5abe6-ccd0-4fe7-b026-4cd5c01d8c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2541690-4077-46e1-bf24-3e918961d8a2', 'volume_name': 'volume-a2541690-4077-46e1-bf24-3e918961d8a2', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd0db70-a7d0-4d5a-8ea4-6fc587941ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd0db70-a7d0-4d5a-8ea4-6fc587941ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff697ea-fe5c-4630-9c33-e772482624a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:01 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Volume a2541690-4077-46e1-bf24-3e918961d8a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2541690-4077-46e1-bf24-3e918961d8a2', 'volume_size': 1} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1447392976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2541690-4077-46e1-bf24-3e918961d8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8fee1efb4497f8430a0ba25aa3f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:02Z,use_quota=True,user_id='e9dc13a8f52d4fa585ec1b37cc9c3d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Creating volume a2541690-4077-46e1-bf24-3e918961d8a2 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:04:01 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2541690-4077-46e1-bf24-3e918961d8a2 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-5815b3c1-050c-4012-ab03-8ea5cf96b864" acquired by "delete_snapshot" :: waited 0.148s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-125c5ed6-22d0-4246-820e-7758d64fa52e" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:01 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2541690-4077-46e1-bf24-3e918961d8a2 1073741824 Sep 25 11:04:01 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-125c5ed6-22d0-4246-820e-7758d64fa52e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Deleting offline snapshot 125c5ed6-22d0-4246-820e-7758d64fa52e of volume 5815b3c1-050c-4012-ab03-8ea5cf96b864 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] snapshot_file for this snap is: volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9bed09-915f-47c9-a62d-28566cf6dc50]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:01 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.359s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:01 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Deleted volume successfully. Sep 25 11:04:01 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-1b6a0b84-fbb8-48f8-9fb7-1d25040d03bc tempest-ProjectMemberTests-1612262589 None] Lock "cinder-dcee3845-a43d-4b2f-8157-573a5dd9d2d3-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:01 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e Sep 25 11:04:01 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:02 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2541690-4077-46e1-bf24-3e918961d8a2 1073741824" returned: 0 in 0.615s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:02 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e" returned: 0 in 0.534s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5815b3c1-050c-4012-ab03-8ea5cf96b864(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2541690-4077-46e1-bf24-3e918961d8a2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c7359a-2aa2-4cb4-9d87-c566c88165a7]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:02 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2541690-4077-46e1-bf24-3e918961d8a2 Sep 25 11:04:02 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:02 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 Sep 25 11:04:02 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:02 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2541690-4077-46e1-bf24-3e918961d8a2" returned: 0 in 0.300s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff697ea-fe5c-4630-9c33-e772482624a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2541690-4077-46e1-bf24-3e918961d8a2', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5f1af5-d890-4383-8e79-777c38cb0896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:02 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Volume volume-a2541690-4077-46e1-bf24-3e918961d8a2 (a2541690-4077-46e1-bf24-3e918961d8a2): created successfully Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5f1af5-d890-4383-8e79-777c38cb0896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Flow 'volume_create_manager' (4035dd59-c452-46cd-ab8b-f322903ee607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:02 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-81ba8afb-9dfa-4409-bde2-28017ea54933 tempest-ProjectReaderTests-916776346 None] Created volume successfully. Sep 25 11:04:02 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864" returned: 0 in 0.411s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:02 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:02 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e Sep 25 11:04:02 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (f1a693b6-02e0-4ad8-b406-ccb09212e133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879037c2-28e9-4049-a576-6752e4a97e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879037c2-28e9-4049-a576-6752e4a97e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1795178619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459a2a91-6e67-4416-9ecc-65d71fc88811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:03Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc42853-fcb2-4b0d-aa16-07920dbde409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc42853-fcb2-4b0d-aa16-07920dbde409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66dec86-8065-4d27-b091-0912cad8764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66dec86-8065-4d27-b091-0912cad8764c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '459a2a91-6e67-4416-9ecc-65d71fc88811', 'volume_name': 'volume-459a2a91-6e67-4416-9ecc-65d71fc88811', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdc1545-d35f-4084-b024-87f1cecdbd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdc1545-d35f-4084-b024-87f1cecdbd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820c7650-d6a0-4572-bd1c-33b2532023c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:03 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Volume 459a2a91-6e67-4416-9ecc-65d71fc88811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-459a2a91-6e67-4416-9ecc-65d71fc88811', 'volume_size': 1} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1795178619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459a2a91-6e67-4416-9ecc-65d71fc88811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:03Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Creating volume 459a2a91-6e67-4416-9ecc-65d71fc88811 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:03 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:04:03 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e" returned: 0 in 0.402s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:03 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811 1073741824 Sep 25 11:04:03 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:03 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e Sep 25 11:04:03 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:03 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864.125c5ed6-22d0-4246-820e-7758d64fa52e" returned: 0 in 0.264s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-125c5ed6-22d0-4246-820e-7758d64fa52e" released by "_delete_snapshot" :: held 1.755s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-5815b3c1-050c-4012-ab03-8ea5cf96b864" released by "delete_snapshot" :: held 1.790s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Created reservations ['bef565b1-3f44-4a69-9a5e-9c675055d9e2', 'e3f8acb8-7ce8-4af5-a1b2-c090a4c99827', '12c4d60d-cff3-4057-af80-ca1cbd8dc62a', 'e1631618-c6ea-495a-8b37-2d0357f728f7'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:03 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Delete snapshot completed successfully. Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-0287f042-ee89-4e46-a1ee-907f400479f9 tempest-ProjectReaderTests-330771959 None] Lock "cinder-125c5ed6-22d0-4246-820e-7758d64fa52e-delete_snapshot" released by "delete_snapshot" :: held 2.092s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:03 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811 1073741824" returned: 0 in 0.531s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Acquiring lock "cinder-a2541690-4077-46e1-bf24-3e918961d8a2-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Lock "cinder-a2541690-4077-46e1-bf24-3e918961d8a2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:03 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811 Sep 25 11:04:03 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Acquiring lock "cinder-quobyte-a2541690-4077-46e1-bf24-3e918961d8a2" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Lock "cinder-quobyte-a2541690-4077-46e1-bf24-3e918961d8a2" acquired by "delete_volume" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2371f883-3b3f-477c-a52f-6d3ecd1db4ae]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:03 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2541690-4077-46e1-bf24-3e918961d8a2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:03 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2541690-4077-46e1-bf24-3e918961d8a2 Sep 25 11:04:03 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:04 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811" returned: 0 in 0.296s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820c7650-d6a0-4572-bd1c-33b2532023c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459a2a91-6e67-4416-9ecc-65d71fc88811', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af825582-002d-45f1-b8a3-7874adab3836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:04 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Volume volume-459a2a91-6e67-4416-9ecc-65d71fc88811 (459a2a91-6e67-4416-9ecc-65d71fc88811): created successfully Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af825582-002d-45f1-b8a3-7874adab3836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (f1a693b6-02e0-4ad8-b406-ccb09212e133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:04 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-c3bce4e6-6757-4034-b7cc-1125f0f2cfe1 tempest-ProjectMemberTests-1612262589 None] Created volume successfully. Sep 25 11:04:04 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2541690-4077-46e1-bf24-3e918961d8a2" returned: 0 in 0.414s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2541690-4077-46e1-bf24-3e918961d8a2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:04 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2541690-4077-46e1-bf24-3e918961d8a2 Sep 25 11:04:04 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:04 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a2541690-4077-46e1-bf24-3e918961d8a2" returned: 0 in 0.245s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Lock "cinder-quobyte-a2541690-4077-46e1-bf24-3e918961d8a2" released by "delete_volume" :: held 0.706s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Created reservations ['4a4f437d-8860-40e4-9db2-6f9776e6e069', 'cc1a66c8-0e13-432c-809b-ac7838717843', 'a6055eaa-1086-42f4-899d-ebbd7535d1e1', 'bab62cb4-0541-4e2c-8c53-a84845071e1a'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:04 devstack sudo[108995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:04 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-5815b3c1-050c-4012-ab03-8ea5cf96b864-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Lock "cinder-5815b3c1-050c-4012-ab03-8ea5cf96b864-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-5815b3c1-050c-4012-ab03-8ea5cf96b864" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-5815b3c1-050c-4012-ab03-8ea5cf96b864" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65ad726-0e9b-4e58-a883-a24e5638a332]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:04 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.302s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:04 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:05 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Deleted volume successfully. Sep 25 11:04:05 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 Sep 25 11:04:05 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cf5292b1-b443-4bfa-8b91-dd1c4715026c tempest-ProjectReaderTests-916776346 None] Lock "cinder-a2541690-4077-46e1-bf24-3e918961d8a2-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:05 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864" returned: 0 in 0.470s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:05 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864 Sep 25 11:04:05 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] Creating offline snapshot dc898443-c462-4182-ad64-fa24f06361f0 of volume 459a2a91-6e67-4416-9ecc-65d71fc88811 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Flow 'volume_create_manager' (47fcf385-24b0-4e11-abac-c993f1aea316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5b8a43-0726-4a33-995c-cc6377367089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18564cd-d7fb-4f71-94d0-b7eb3a5e2706]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:05 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5815b3c1-050c-4012-ab03-8ea5cf96b864" returned: 0 in 0.277s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5b8a43-0726-4a33-995c-cc6377367089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403811965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337f819f-648b-4686-8876-415788065946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8fee1efb4497f8430a0ba25aa3f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:06Z,use_quota=True,user_id='e9dc13a8f52d4fa585ec1b37cc9c3d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d07a1d-ff09-4c1f-8a9d-b44b190a76a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d07a1d-ff09-4c1f-8a9d-b44b190a76a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed39747-b460-4b9c-8006-e91b5905e690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed39747-b460-4b9c-8006-e91b5905e690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '337f819f-648b-4686-8876-415788065946', 'volume_name': 'volume-337f819f-648b-4686-8876-415788065946', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6a00af-d5e6-48bb-999d-a199e4f8723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6a00af-d5e6-48bb-999d-a199e4f8723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ef9612-de11-495c-8e43-82e046a6d86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:05 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Volume 337f819f-648b-4686-8876-415788065946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-337f819f-648b-4686-8876-415788065946', 'volume_size': 1} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-5815b3c1-050c-4012-ab03-8ea5cf96b864" released by "delete_volume" :: held 0.893s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:05 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811 Sep 25 11:04:05 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Created reservations ['38d306d9-2b15-4d0e-94cf-e01c78a10f86', '2d113a0d-0e00-4396-8e8d-ec1bcee5d2ab', '6a05f856-ba51-4b58-8e6f-d0086e82110c', 'fb9963b6-6f03-4e8b-9361-5af9526b4feb'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:05 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:05 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:05 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:06 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811" returned: 0 in 0.426s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:06 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 1G Sep 25 11:04:06 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:06 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.316s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:06 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Deleted volume successfully. Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2de32ee7-d68a-450c-8a4d-de75607cd3a0 tempest-ProjectReaderTests-330771959 None] Lock "cinder-5815b3c1-050c-4012-ab03-8ea5cf96b864-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Flow 'volume_create_manager' (63a83c08-d474-44b6-9e83-d7d9b8767a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:06 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682b6207-b62d-4abb-ae7f-5dabdbab64d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 1G" returned: 0 in 0.495s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459a2a91-6e67-4416-9ecc-65d71fc88811 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:06 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459a2a91-6e67-4416-9ecc-65d71fc88811 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682b6207-b62d-4abb-ae7f-5dabdbab64d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122888388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3306174e-9955-40f7-9549-15b8adc343e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc760b9e55140aca9ee821d0a06d9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:06Z,use_quota=True,user_id='b1e4775c380f4be59076858366e912bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:06 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5f870a-fe31-455f-ad6c-ac336c837e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5f870a-fe31-455f-ad6c-ac336c837e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdb7b85-f635-4a87-95d7-4cbe401cddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdb7b85-f635-4a87-95d7-4cbe401cddc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3306174e-9955-40f7-9549-15b8adc343e7', 'volume_name': 'volume-3306174e-9955-40f7-9549-15b8adc343e7', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799d3e7c-4b7c-41a8-a67b-49504942e3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799d3e7c-4b7c-41a8-a67b-49504942e3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e53f71-4824-4b3e-bc2b-b39972d6bfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:06 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Volume 3306174e-9955-40f7-9549-15b8adc343e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3306174e-9955-40f7-9549-15b8adc343e7', 'volume_size': 1} Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:06 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459a2a91-6e67-4416-9ecc-65d71fc88811 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0" returned: 0 in 0.293s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:06 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 is being set with open permissions: ugo+rw Sep 25 11:04:06 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:06 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 Sep 25 11:04:06 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:07 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0" returned: 0 in 0.256s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:07 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.info Sep 25 11:04:07 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:07 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.info" returned: 0 in 0.248s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:07 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.info is being set with open permissions: ugo+rw Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:07 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.info Sep 25 11:04:07 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:07 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.info" returned: 0 in 0.242s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.920s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403811965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337f819f-648b-4686-8876-415788065946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8fee1efb4497f8430a0ba25aa3f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:06Z,use_quota=True,user_id='e9dc13a8f52d4fa585ec1b37cc9c3d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Creating volume 337f819f-648b-4686-8876-415788065946 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:04:07 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:04:07 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-337f819f-648b-4686-8876-415788065946 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:07 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-337f819f-648b-4686-8876-415788065946 1073741824 Sep 25 11:04:07 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:07 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-195d1975-66cc-442a-9c47-45b7b9d5e205 tempest-ProjectMemberTests-1612262589 None] Create snapshot completed successfully Sep 25 11:04:08 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-337f819f-648b-4686-8876-415788065946 1073741824" returned: 0 in 0.424s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-337f819f-648b-4686-8876-415788065946 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:08 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-337f819f-648b-4686-8876-415788065946 Sep 25 11:04:08 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:08 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-337f819f-648b-4686-8876-415788065946" returned: 0 in 0.269s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.765s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122888388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3306174e-9955-40f7-9549-15b8adc343e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc760b9e55140aca9ee821d0a06d9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:06Z,use_quota=True,user_id='b1e4775c380f4be59076858366e912bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Creating volume 3306174e-9955-40f7-9549-15b8adc343e7 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:04:08 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ef9612-de11-495c-8e43-82e046a6d86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-337f819f-648b-4686-8876-415788065946', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:08 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7 1073741824 Sep 25 11:04:08 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed05ec0-3487-413d-a176-60297abaf3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:08 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Volume volume-337f819f-648b-4686-8876-415788065946 (337f819f-648b-4686-8876-415788065946): created successfully Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed05ec0-3487-413d-a176-60297abaf3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Flow 'volume_create_manager' (47fcf385-24b0-4e11-abac-c993f1aea316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:08 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4248227e-78d7-47f0-afa8-9f8a1fbfe29e tempest-ProjectReaderTests-916776346 None] Created volume successfully. Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-dc898443-c462-4182-ad64-fa24f06361f0-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-dc898443-c462-4182-ad64-fa24f06361f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-459a2a91-6e67-4416-9ecc-65d71fc88811" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-459a2a91-6e67-4416-9ecc-65d71fc88811" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-dc898443-c462-4182-ad64-fa24f06361f0" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-dc898443-c462-4182-ad64-fa24f06361f0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Deleting offline snapshot dc898443-c462-4182-ad64-fa24f06361f0 of volume 459a2a91-6e67-4416-9ecc-65d71fc88811 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] snapshot_file for this snap is: volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Acquiring lock "cinder-337f819f-648b-4686-8876-415788065946-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Lock "cinder-337f819f-648b-4686-8876-415788065946-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b315fc26-22e1-4116-9ac5-276a96f5bf25]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Acquiring lock "cinder-quobyte-337f819f-648b-4686-8876-415788065946" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Lock "cinder-quobyte-337f819f-648b-4686-8876-415788065946" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0004ff5b-ba79-4e42-b783-2a766a611956]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-337f819f-648b-4686-8876-415788065946 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:08 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 Sep 25 11:04:08 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:08 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7 1073741824" returned: 0 in 0.533s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:08 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:08 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-337f819f-648b-4686-8876-415788065946 Sep 25 11:04:08 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:08 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7 Sep 25 11:04:08 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:09 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0" returned: 0 in 0.404s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459a2a91-6e67-4416-9ecc-65d71fc88811(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f2f4ab-c8c6-4ddd-82d2-f91114d44af2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:09 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7" returned: 0 in 0.278s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:09 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-337f819f-648b-4686-8876-415788065946" returned: 0 in 0.406s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-337f819f-648b-4686-8876-415788065946 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e53f71-4824-4b3e-bc2b-b39972d6bfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3306174e-9955-40f7-9549-15b8adc343e7', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba27566c-4aa1-4a86-be39-3e9332c6f7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:09 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-337f819f-648b-4686-8876-415788065946 Sep 25 11:04:09 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:09 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Volume volume-3306174e-9955-40f7-9549-15b8adc343e7 (3306174e-9955-40f7-9549-15b8adc343e7): created successfully Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba27566c-4aa1-4a86-be39-3e9332c6f7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Flow 'volume_create_manager' (63a83c08-d474-44b6-9e83-d7d9b8767a5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:09 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811 Sep 25 11:04:09 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:09 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-db4e72ad-d5e1-4343-9a6d-aaf0c18e914b tempest-ProjectReaderTests-330771959 None] Created volume successfully. Sep 25 11:04:09 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-337f819f-648b-4686-8876-415788065946" returned: 0 in 0.259s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Lock "cinder-quobyte-337f819f-648b-4686-8876-415788065946" released by "delete_volume" :: held 0.709s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Created reservations ['98331050-d563-40b7-842a-d1e9cc187c64', 'd5c6f47f-b5f4-4d1b-a03e-656084cea835', 'c0d6cfc9-1e66-4917-be90-c5351ca93bd1', '627c2de0-49ec-4a63-a925-c0c213b00e35'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:09 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811" returned: 0 in 0.426s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:09 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 Sep 25 11:04:09 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:09 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:09 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] Creating offline snapshot 48790472-557d-4c3a-aee4-20e7b80b8434 of volume 3306174e-9955-40f7-9549-15b8adc343e7 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e73c6ee-9743-4e2c-9b35-e83e1b9b715d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:09 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.311s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:09 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:09 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Deleted volume successfully. Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bc549b7b-63d2-41ee-a15b-aed5feffc3fd tempest-ProjectReaderTests-916776346 None] Lock "cinder-337f819f-648b-4686-8876-415788065946-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:10 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7 Sep 25 11:04:10 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:10 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0" returned: 0 in 0.484s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:10 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0 Sep 25 11:04:10 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:10 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7" returned: 0 in 0.442s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:10 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811.dc898443-c462-4182-ad64-fa24f06361f0" returned: 0 in 0.294s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:10 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 1G Sep 25 11:04:10 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-dc898443-c462-4182-ad64-fa24f06361f0" released by "_delete_snapshot" :: held 1.765s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-459a2a91-6e67-4416-9ecc-65d71fc88811" released by "delete_snapshot" :: held 1.795s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Flow 'volume_create_manager' (85aedcec-c7ba-4bc7-9a91-6183eb566249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f4752a-7194-4271-8e3b-e1b92c5db674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f4752a-7194-4271-8e3b-e1b92c5db674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-295964208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133050f7-c0a7-4baa-8821-70a2fe6cca06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8fee1efb4497f8430a0ba25aa3f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:10Z,use_quota=True,user_id='e9dc13a8f52d4fa585ec1b37cc9c3d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439e9443-eed9-4452-a630-d6f766ee2e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439e9443-eed9-4452-a630-d6f766ee2e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e9e03d-b837-46f4-9a79-d5c29deba41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e9e03d-b837-46f4-9a79-d5c29deba41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '133050f7-c0a7-4baa-8821-70a2fe6cca06', 'volume_name': 'volume-133050f7-c0a7-4baa-8821-70a2fe6cca06', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d7d2df-ff9c-45e0-9ab4-4a8d7cb0d265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d7d2df-ff9c-45e0-9ab4-4a8d7cb0d265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63787c7-ee43-419c-8bb3-94d182a050d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:10 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Volume 133050f7-c0a7-4baa-8821-70a2fe6cca06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-133050f7-c0a7-4baa-8821-70a2fe6cca06', 'volume_size': 1} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Created reservations ['7e2c5a5c-62ad-4699-9a7d-b7dfa45d9b7e', '58105b78-07af-44dc-9dc3-c58489c8a0af', 'c32f6b17-ba62-42cb-9ead-bcc977b9728e', 'd8f466e0-b692-46f9-88f5-405f604cde06'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:10 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Delete snapshot completed successfully. Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-302d5336-4f0c-428d-8f09-dc0389abbbc9 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-dc898443-c462-4182-ad64-fa24f06361f0-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:10 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-459a2a91-6e67-4416-9ecc-65d71fc88811-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 1G" returned: 0 in 0.438s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3306174e-9955-40f7-9549-15b8adc343e7 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-459a2a91-6e67-4416-9ecc-65d71fc88811-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:10 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3306174e-9955-40f7-9549-15b8adc343e7 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 Sep 25 11:04:10 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-459a2a91-6e67-4416-9ecc-65d71fc88811" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-459a2a91-6e67-4416-9ecc-65d71fc88811" acquired by "delete_volume" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5105dbe2-b6f8-4757-842a-4e7e5a6aa848]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:10 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:11 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811 Sep 25 11:04:11 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:11 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3306174e-9955-40f7-9549-15b8adc343e7 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434" returned: 0 in 0.331s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:11 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 is being set with open permissions: ugo+rw Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:11 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 Sep 25 11:04:11 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:11 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811" returned: 0 in 0.402s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:11 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811 Sep 25 11:04:11 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:11 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434" returned: 0 in 0.314s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:11 devstack sudo[109108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.info Sep 25 11:04:11 devstack sudo[109108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:11 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-459a2a91-6e67-4416-9ecc-65d71fc88811" returned: 0 in 0.242s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-459a2a91-6e67-4416-9ecc-65d71fc88811" released by "delete_volume" :: held 0.707s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Created reservations ['9cd80f96-aee6-41b7-aa60-aafd4fe98b69', 'dbe4bc1c-b184-49db-9776-298c9d657124', '20cdf2ac-6f24-4e4b-90c1-67c6f064c9e8', '7ea51287-f46c-41a2-952f-e83c6816dc2b'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:11 devstack sudo[109112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:11 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:11 devstack sudo[109108]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.info" returned: 0 in 0.317s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:11 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.info is being set with open permissions: ugo+rw Sep 25 11:04:11 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:11 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.info Sep 25 11:04:11 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:12 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.288s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:12 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Deleted volume successfully. Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6ae1386a-1293-499f-a073-8c285c7b615b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-459a2a91-6e67-4416-9ecc-65d71fc88811-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:12 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.info" returned: 0 in 0.295s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.566s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-295964208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133050f7-c0a7-4baa-8821-70a2fe6cca06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8fee1efb4497f8430a0ba25aa3f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:10Z,use_quota=True,user_id='e9dc13a8f52d4fa585ec1b37cc9c3d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Creating volume 133050f7-c0a7-4baa-8821-70a2fe6cca06 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:04:12 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-133050f7-c0a7-4baa-8821-70a2fe6cca06 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:12 devstack sudo[109118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-133050f7-c0a7-4baa-8821-70a2fe6cca06 1073741824 Sep 25 11:04:12 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:12 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-99d8f1b6-e656-467e-b3d7-6fec60177ffa tempest-ProjectReaderTests-330771959 None] Create snapshot completed successfully Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (a45406d1-376f-4550-8d5a-e1ab5c423619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bab9ea1-dce3-4610-aecf-9431f03d76b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bab9ea1-dce3-4610-aecf-9431f03d76b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2924258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c68fd9f-f653-4042-bd9a-da196dcb6db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:12Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1823799a-98b0-4dda-a011-e92b3fbad444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1823799a-98b0-4dda-a011-e92b3fbad444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353a17fd-8f5a-477b-9286-3135025aa8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353a17fd-8f5a-477b-9286-3135025aa8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c68fd9f-f653-4042-bd9a-da196dcb6db8', 'volume_name': 'volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd40093-ffbb-46b4-88e3-ff8bc3282890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd40093-ffbb-46b4-88e3-ff8bc3282890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc7a9ed-8c0c-455c-a51f-ab7c90065b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:12 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Volume 9c68fd9f-f653-4042-bd9a-da196dcb6db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8', 'volume_size': 1} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:12 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-133050f7-c0a7-4baa-8821-70a2fe6cca06 1073741824" returned: 0 in 0.515s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-133050f7-c0a7-4baa-8821-70a2fe6cca06 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:12 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-133050f7-c0a7-4baa-8821-70a2fe6cca06 Sep 25 11:04:12 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:12 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-133050f7-c0a7-4baa-8821-70a2fe6cca06" returned: 0 in 0.249s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2924258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c68fd9f-f653-4042-bd9a-da196dcb6db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:12Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Creating volume 9c68fd9f-f653-4042-bd9a-da196dcb6db8 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:04:12 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63787c7-ee43-419c-8bb3-94d182a050d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-133050f7-c0a7-4baa-8821-70a2fe6cca06', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565486ac-a285-4b87-a05a-a6ca10eda0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:12 devstack sudo[109127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 1073741824 Sep 25 11:04:12 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:12 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Volume volume-133050f7-c0a7-4baa-8821-70a2fe6cca06 (133050f7-c0a7-4baa-8821-70a2fe6cca06): created successfully Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565486ac-a285-4b87-a05a-a6ca10eda0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:12 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Flow 'volume_create_manager' (85aedcec-c7ba-4bc7-9a91-6183eb566249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f6654a1b-416e-4c44-a52c-0fe62f5ecece tempest-ProjectReaderTests-916776346 None] Created volume successfully. Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-48790472-557d-4c3a-aee4-20e7b80b8434-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Lock "cinder-48790472-557d-4c3a-aee4-20e7b80b8434-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-3306174e-9955-40f7-9549-15b8adc343e7" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-3306174e-9955-40f7-9549-15b8adc343e7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-48790472-557d-4c3a-aee4-20e7b80b8434" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-48790472-557d-4c3a-aee4-20e7b80b8434" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Deleting offline snapshot 48790472-557d-4c3a-aee4-20e7b80b8434 of volume 3306174e-9955-40f7-9549-15b8adc343e7 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] snapshot_file for this snap is: volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01b8ef1-6312-417b-aef5-1cd7e94b6581]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:13 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 Sep 25 11:04:13 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:13 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 1073741824" returned: 0 in 0.536s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:13 devstack sudo[109136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 Sep 25 11:04:13 devstack sudo[109136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:13 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434" returned: 0 in 0.462s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3306174e-9955-40f7-9549-15b8adc343e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Acquiring lock "cinder-133050f7-c0a7-4baa-8821-70a2fe6cca06-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da9248a-9754-4d7c-9d26-0010f1148fbb]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Lock "cinder-133050f7-c0a7-4baa-8821-70a2fe6cca06-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Acquiring lock "cinder-quobyte-133050f7-c0a7-4baa-8821-70a2fe6cca06" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Lock "cinder-quobyte-133050f7-c0a7-4baa-8821-70a2fe6cca06" acquired by "delete_volume" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[60851785-6b5a-43ae-93be-998ef0fe7ff2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-133050f7-c0a7-4baa-8821-70a2fe6cca06 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:13 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7 Sep 25 11:04:13 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:13 devstack sudo[109136]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8" returned: 0 in 0.323s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc7a9ed-8c0c-455c-a51f-ab7c90065b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5343b1bc-a320-4b89-9959-63786aed95fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:13 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-133050f7-c0a7-4baa-8821-70a2fe6cca06 Sep 25 11:04:13 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:13 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Volume volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 (9c68fd9f-f653-4042-bd9a-da196dcb6db8): created successfully Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5343b1bc-a320-4b89-9959-63786aed95fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:13 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (a45406d1-376f-4550-8d5a-e1ab5c423619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:13 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-fd02343f-9f3f-41b4-b422-6bcf51b39fe7 tempest-ProjectMemberTests-1612262589 None] Created volume successfully. Sep 25 11:04:14 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7" returned: 0 in 0.444s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:14 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 Sep 25 11:04:14 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:14 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-133050f7-c0a7-4baa-8821-70a2fe6cca06" returned: 0 in 0.445s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-133050f7-c0a7-4baa-8821-70a2fe6cca06 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:14 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-133050f7-c0a7-4baa-8821-70a2fe6cca06 Sep 25 11:04:14 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:14 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:14 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-133050f7-c0a7-4baa-8821-70a2fe6cca06" returned: 0 in 0.259s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434" returned: 0 in 0.375s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Lock "cinder-quobyte-133050f7-c0a7-4baa-8821-70a2fe6cca06" released by "delete_volume" :: held 0.759s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:14 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434 Sep 25 11:04:14 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Created reservations ['6c484594-8fc3-4254-ba98-767b18d78d03', '51b381b6-ba7a-45f1-95f5-ad55bb919550', '2d324cde-beee-4264-a088-aa1096883b39', '2ef1a5de-0d0b-48db-913b-ab9f4d0eedcc'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:14 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:14 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:14 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7.48790472-557d-4c3a-aee4-20e7b80b8434" returned: 0 in 0.305s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-48790472-557d-4c3a-aee4-20e7b80b8434" released by "_delete_snapshot" :: held 1.752s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-3306174e-9955-40f7-9549-15b8adc343e7" released by "delete_snapshot" :: held 1.785s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] Creating offline snapshot 7fe4249a-5133-4d0c-ad69-033487775dcb of volume 9c68fd9f-f653-4042-bd9a-da196dcb6db8 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[716bd30d-62b8-407a-bf0f-eb01fa1df410]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Created reservations ['bf170738-0e69-4b8f-b972-08b4db6fd7de', 'c5f313c6-cec4-48b5-a8cd-002cc218e4ea', 'ed952815-17f3-4b0e-a2e6-8af5e7f5ce03', '8e495b95-5be7-45f7-9dc5-2b30ca39447a'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:14 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.354s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:14 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:15 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Deleted volume successfully. Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-2871d35b-62d8-424a-bb10-442dc3c63dc5 tempest-ProjectReaderTests-916776346 None] Lock "cinder-133050f7-c0a7-4baa-8821-70a2fe6cca06-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:15 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Delete snapshot completed successfully. Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-fbe9d6bc-be54-499a-8f51-d2b982fede97 tempest-ProjectReaderTests-330771959 None] Lock "cinder-48790472-557d-4c3a-aee4-20e7b80b8434-delete_snapshot" released by "delete_snapshot" :: held 2.011s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:15 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 Sep 25 11:04:15 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-3306174e-9955-40f7-9549-15b8adc343e7-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Lock "cinder-3306174e-9955-40f7-9549-15b8adc343e7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-3306174e-9955-40f7-9549-15b8adc343e7" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-3306174e-9955-40f7-9549-15b8adc343e7" acquired by "delete_volume" :: waited 0.026s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[96da713a-21b4-467b-819d-8847858097de]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:15 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8" returned: 0 in 0.517s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:15 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb 1G Sep 25 11:04:15 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Flow 'volume_create_manager' (3fe5c047-c333-4bec-99fd-2974d3e8d423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6df186-2685-48e4-9ddb-09b719d45134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6df186-2685-48e4-9ddb-09b719d45134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1985525448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f25fb70-cd45-4d46-b476-789eee502e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8fee1efb4497f8430a0ba25aa3f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:15Z,use_quota=True,user_id='e9dc13a8f52d4fa585ec1b37cc9c3d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:15 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7 Sep 25 11:04:15 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddea67e1-d9ad-4542-a5ec-25dcc3133274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddea67e1-d9ad-4542-a5ec-25dcc3133274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54cb0482-000f-4c62-91ea-cdc2b8289502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54cb0482-000f-4c62-91ea-cdc2b8289502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f25fb70-cd45-4d46-b476-789eee502e81', 'volume_name': 'volume-5f25fb70-cd45-4d46-b476-789eee502e81', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bea02b0-1995-4a19-a117-e03bd55a85e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bea02b0-1995-4a19-a117-e03bd55a85e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517063c7-0cde-4b07-92d0-024f67fa8508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:15 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Volume 5f25fb70-cd45-4d46-b476-789eee502e81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f25fb70-cd45-4d46-b476-789eee502e81', 'volume_size': 1} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:15 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7" returned: 0 in 0.477s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:15 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb 1G" returned: 0 in 0.474s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:15 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:15 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7 Sep 25 11:04:15 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:15 devstack sudo[109182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb Sep 25 11:04:15 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:16 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-3306174e-9955-40f7-9549-15b8adc343e7" returned: 0 in 0.273s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-3306174e-9955-40f7-9549-15b8adc343e7" released by "delete_volume" :: held 0.838s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Created reservations ['f802e9a1-88d5-4303-a6d3-7f1c3525d533', '3ff7eb69-8262-4c20-9b0e-bcaccf9af8c4', '8ebd962a-2d06-41ac-9b26-6b1f263a71cf', '9f6a9141-641f-47ed-b991-1a8366d2fbde'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:16 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb" returned: 0 in 0.351s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:16 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb is being set with open permissions: ugo+rw Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:16 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb Sep 25 11:04:16 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:16 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:16 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:16 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb" returned: 0 in 0.282s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:16 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.info Sep 25 11:04:16 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:16 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.297s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:16 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Deleted volume successfully. Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-6e2e94cf-0e59-428d-9f1d-4ddac6c6f5fd tempest-ProjectReaderTests-330771959 None] Lock "cinder-3306174e-9955-40f7-9549-15b8adc343e7-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:16 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.info" returned: 0 in 0.336s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:16 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.info is being set with open permissions: ugo+rw Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:16 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.info Sep 25 11:04:16 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:16 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Flow 'volume_create_manager' (7b7da636-cf0b-4f42-ac89-2aff191d5344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aaff9d5-ae63-43d5-b714-3988e8acb27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aaff9d5-ae63-43d5-b714-3988e8acb27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573047512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fa1f29-064f-4f18-82fe-5a37ee2fdf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc760b9e55140aca9ee821d0a06d9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:17Z,use_quota=True,user_id='b1e4775c380f4be59076858366e912bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f330268f-e771-448d-b0c9-fa91af5b4d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f330268f-e771-448d-b0c9-fa91af5b4d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a991e04b-2aaa-4226-9cf3-f7fc717be4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a991e04b-2aaa-4226-9cf3-f7fc717be4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80fa1f29-064f-4f18-82fe-5a37ee2fdf5f', 'volume_name': 'volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d859893-2acb-4051-9175-d60bb4246377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d859893-2acb-4051-9175-d60bb4246377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6b23dd-f5c9-43a0-be82-1db30b3d48e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:17 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Volume 80fa1f29-064f-4f18-82fe-5a37ee2fdf5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f', 'volume_size': 1} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:17 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.info" returned: 0 in 0.274s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.624s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1985525448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f25fb70-cd45-4d46-b476-789eee502e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8fee1efb4497f8430a0ba25aa3f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:15Z,use_quota=True,user_id='e9dc13a8f52d4fa585ec1b37cc9c3d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Creating volume 5f25fb70-cd45-4d46-b476-789eee502e81 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:04:17 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5f25fb70-cd45-4d46-b476-789eee502e81 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:17 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5f25fb70-cd45-4d46-b476-789eee502e81 1073741824 Sep 25 11:04:17 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:17 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-dcd07b4b-15ef-4ec5-84fc-4e4f18239935 tempest-ProjectMemberTests-1612262589 None] Create snapshot completed successfully Sep 25 11:04:17 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5f25fb70-cd45-4d46-b476-789eee502e81 1073741824" returned: 0 in 0.435s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:17 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5f25fb70-cd45-4d46-b476-789eee502e81 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:17 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5f25fb70-cd45-4d46-b476-789eee502e81 Sep 25 11:04:17 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:18 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5f25fb70-cd45-4d46-b476-789eee502e81" returned: 0 in 0.317s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573047512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fa1f29-064f-4f18-82fe-5a37ee2fdf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc760b9e55140aca9ee821d0a06d9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:17Z,use_quota=True,user_id='b1e4775c380f4be59076858366e912bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Creating volume 80fa1f29-064f-4f18-82fe-5a37ee2fdf5f {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:04:18 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-7fe4249a-5133-4d0c-ad69-033487775dcb-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517063c7-0cde-4b07-92d0-024f67fa8508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f25fb70-cd45-4d46-b476-789eee502e81', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a3c6dd-c406-4368-916f-e87b3b13823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:18 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f 1073741824 Sep 25 11:04:18 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-7fe4249a-5133-4d0c-ad69-033487775dcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-9c68fd9f-f653-4042-bd9a-da196dcb6db8" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:18 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Volume volume-5f25fb70-cd45-4d46-b476-789eee502e81 (5f25fb70-cd45-4d46-b476-789eee502e81): created successfully Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a3c6dd-c406-4368-916f-e87b3b13823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Flow 'volume_create_manager' (3fe5c047-c333-4bec-99fd-2974d3e8d423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-9c68fd9f-f653-4042-bd9a-da196dcb6db8" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-7fe4249a-5133-4d0c-ad69-033487775dcb" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-e960257c-4a93-47b0-a700-4aa9d7ee7f6d tempest-ProjectReaderTests-916776346 None] Created volume successfully. Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-7fe4249a-5133-4d0c-ad69-033487775dcb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Deleting offline snapshot 7fe4249a-5133-4d0c-ad69-033487775dcb of volume 9c68fd9f-f653-4042-bd9a-da196dcb6db8 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] snapshot_file for this snap is: volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9603e93-cb6a-432f-8bf3-5700b0a45fc3]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:18 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb Sep 25 11:04:18 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:18 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f 1073741824" returned: 0 in 0.476s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:18 devstack sudo[109223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f Sep 25 11:04:18 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:18 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb" returned: 0 in 0.441s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a84eca1-b1fd-44ff-b777-53eb300a9eb2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Acquiring lock "cinder-5f25fb70-cd45-4d46-b476-789eee502e81-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Lock "cinder-5f25fb70-cd45-4d46-b476-789eee502e81-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:18 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 Sep 25 11:04:18 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Acquiring lock "cinder-quobyte-5f25fb70-cd45-4d46-b476-789eee502e81" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:18 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f" returned: 0 in 0.301s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Lock "cinder-quobyte-5f25fb70-cd45-4d46-b476-789eee502e81" acquired by "delete_volume" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6b23dd-f5c9-43a0-be82-1db30b3d48e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36df51d1-4b18-45fd-a0f9-fba73eabb42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac65480-2433-44f6-97ab-86bf822fc8ad]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5f25fb70-cd45-4d46-b476-789eee502e81 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:18 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Volume volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f (80fa1f29-064f-4f18-82fe-5a37ee2fdf5f): created successfully Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36df51d1-4b18-45fd-a0f9-fba73eabb42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:18 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Flow 'volume_create_manager' (7b7da636-cf0b-4f42-ac89-2aff191d5344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:18 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-fe34234c-9da5-4c9c-8bca-fdea1bb96e16 tempest-ProjectReaderTests-330771959 None] Created volume successfully. Sep 25 11:04:19 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5f25fb70-cd45-4d46-b476-789eee502e81 Sep 25 11:04:19 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:19 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8" returned: 0 in 0.435s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:19 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb Sep 25 11:04:19 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] Creating offline snapshot e8fed66d-0084-4018-a57c-18f62cb70599 of volume 80fa1f29-064f-4f18-82fe-5a37ee2fdf5f {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:04:19 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5f25fb70-cd45-4d46-b476-789eee502e81" returned: 0 in 0.455s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5f25fb70-cd45-4d46-b476-789eee502e81 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cce819-dcf3-4782-a24a-163ff5967427]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:19 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5f25fb70-cd45-4d46-b476-789eee502e81 Sep 25 11:04:19 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:19 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f Sep 25 11:04:19 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:19 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb" returned: 0 in 0.426s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:19 devstack sudo[109246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb Sep 25 11:04:19 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:19 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-5f25fb70-cd45-4d46-b476-789eee502e81" returned: 0 in 0.292s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Lock "cinder-quobyte-5f25fb70-cd45-4d46-b476-789eee502e81" released by "delete_volume" :: held 0.813s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Created reservations ['d523164d-56a2-48b5-879d-14e29d653724', '75d3f85d-79dc-4b3b-ac72-5c3557e3bdd4', 'b1cf627f-faac-4e89-ae7f-84d8dba255a0', 'e031b6ce-b60d-4c0e-be91-76bf1c1bf9b9'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:19 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f" returned: 0 in 0.463s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:19 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:19 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:19 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8.7fe4249a-5133-4d0c-ad69-033487775dcb" returned: 0 in 0.341s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:19 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 1G Sep 25 11:04:19 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-7fe4249a-5133-4d0c-ad69-033487775dcb" released by "_delete_snapshot" :: held 1.784s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:19 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-9c68fd9f-f653-4042-bd9a-da196dcb6db8" released by "delete_snapshot" :: held 1.817s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Created reservations ['30ce3a0e-3ec8-4103-8d00-a9cdf4991e7b', '1532faab-3ed4-491b-9cbb-7f6e8d9c4e25', '1f20788d-e099-45d0-9cbe-f4f5ca7e6e8a', '84e33b3c-c3f0-45d2-adfe-c686dd37a9e9'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:20 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Delete snapshot completed successfully. Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-8247a4cb-652e-44b8-b58a-b06b2715ce5b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-7fe4249a-5133-4d0c-ad69-033487775dcb-delete_snapshot" released by "delete_snapshot" :: held 2.037s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:20 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.350s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:20 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Deleted volume successfully. Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5a9fc25b-6d68-4c8b-bf61-54bbb3cdd7cb tempest-ProjectReaderTests-916776346 None] Lock "cinder-5f25fb70-cd45-4d46-b476-789eee502e81-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-9c68fd9f-f653-4042-bd9a-da196dcb6db8-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-9c68fd9f-f653-4042-bd9a-da196dcb6db8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-9c68fd9f-f653-4042-bd9a-da196dcb6db8" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-9c68fd9f-f653-4042-bd9a-da196dcb6db8" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:20 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 1G" returned: 0 in 0.587s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[724b8227-35a9-4a6d-b821-93e6789440ff]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:20 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 Sep 25 11:04:20 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:20 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 Sep 25 11:04:20 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:20 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599" returned: 0 in 0.339s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:20 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 is being set with open permissions: ugo+rw Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:20 devstack sudo[109271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 Sep 25 11:04:20 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:20 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8" returned: 0 in 0.415s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:20 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:20 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8 Sep 25 11:04:20 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:21 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599" returned: 0 in 0.295s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:21 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.info Sep 25 11:04:21 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:21 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-9c68fd9f-f653-4042-bd9a-da196dcb6db8" returned: 0 in 0.374s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-9c68fd9f-f653-4042-bd9a-da196dcb6db8" released by "delete_volume" :: held 0.889s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Created reservations ['9430bd9a-8ccc-4031-b2a6-9844d08bbfab', '21f72108-e275-4ed2-ab60-fdf236368e71', '7b0dafaf-b2ca-483d-b7ed-2fc2549c8c42', '63a726cc-78a1-48dc-863b-3146ab6a5ea7'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:21 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.info" returned: 0 in 0.366s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:21 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.info is being set with open permissions: ugo+rw Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:21 devstack sudo[109282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:21 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:21 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.info Sep 25 11:04:21 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:21 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.309s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:21 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Deleted volume successfully. Sep 25 11:04:21 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.info" returned: 0 in 0.311s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.497s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:21 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-5ac3af52-3595-4886-96f7-0e2a6fb12b52 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-9c68fd9f-f653-4042-bd9a-da196dcb6db8-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:21 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-82806b8c-e49e-4301-a168-133cbb6b176e tempest-ProjectReaderTests-330771959 None] Create snapshot completed successfully Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (c41e3209-170b-42a3-8700-d28587829db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02fb5aa5-78d2-40eb-9b83-17ae68c3c263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02fb5aa5-78d2-40eb-9b83-17ae68c3c263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2008037639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5284aa4-8f19-42c9-83ed-d25e891114f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:22Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (860323fb-877d-4699-a1ef-9630b431f7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (860323fb-877d-4699-a1ef-9630b431f7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16deb7d1-1c29-46fa-8970-c58d308bea86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16deb7d1-1c29-46fa-8970-c58d308bea86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5284aa4-8f19-42c9-83ed-d25e891114f7', 'volume_name': 'volume-f5284aa4-8f19-42c9-83ed-d25e891114f7', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3921d163-c3f1-4b1b-a601-0fb5b133bacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3921d163-c3f1-4b1b-a601-0fb5b133bacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55044a2-69f9-46c6-834c-93612e95c8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:22 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Volume f5284aa4-8f19-42c9-83ed-d25e891114f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5284aa4-8f19-42c9-83ed-d25e891114f7', 'volume_size': 1} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2008037639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5284aa4-8f19-42c9-83ed-d25e891114f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:22Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Creating volume f5284aa4-8f19-42c9-83ed-d25e891114f7 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:04:22 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:22 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 1073741824 Sep 25 11:04:22 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-e8fed66d-0084-4018-a57c-18f62cb70599-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Lock "cinder-e8fed66d-0084-4018-a57c-18f62cb70599-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-e8fed66d-0084-4018-a57c-18f62cb70599" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-e8fed66d-0084-4018-a57c-18f62cb70599" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Deleting offline snapshot e8fed66d-0084-4018-a57c-18f62cb70599 of volume 80fa1f29-064f-4f18-82fe-5a37ee2fdf5f {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] snapshot_file for this snap is: volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d522535d-d1dc-4d5f-8f3b-c2d37e24e9bb]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:22 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:22 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 1073741824" returned: 0 in 0.470s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:22 devstack sudo[109295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 Sep 25 11:04:22 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:23 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599" returned: 0 in 0.407s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:04:23 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef24f9d-a932-44a9-acb1-baf0e2a4cd36]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:23 devstack sudo[109300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f Sep 25 11:04:23 devstack sudo[109300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:23 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 Sep 25 11:04:23 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:23 devstack sudo[109300]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f" returned: 0 in 0.386s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:23 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 Sep 25 11:04:23 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:23 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7" returned: 0 in 0.288s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:23 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:04:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55044a2-69f9-46c6-834c-93612e95c8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5284aa4-8f19-42c9-83ed-d25e891114f7', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:23 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a745535f-cfd8-48f8-8563-0530c195d8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:23 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599" returned: 0 in 0.339s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:23 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:23 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599 Sep 25 11:04:23 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:24 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f.e8fed66d-0084-4018-a57c-18f62cb70599" returned: 0 in 0.250s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-e8fed66d-0084-4018-a57c-18f62cb70599" released by "_delete_snapshot" :: held 1.486s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:24 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f" released by "delete_snapshot" :: held 1.511s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:24 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Volume volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 (f5284aa4-8f19-42c9-83ed-d25e891114f7): created successfully Sep 25 11:04:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a745535f-cfd8-48f8-8563-0530c195d8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (c41e3209-170b-42a3-8700-d28587829db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:24 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Created reservations ['10ce7641-232b-4dc3-b757-9976417d77a3', '1fe1219b-4d4a-43b2-bfa8-6f91957040e4', 'bb7d7b3f-6279-47b6-85dd-2889a0be89b3', 'a49926b7-b548-4eff-998f-b27607bce2d7'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:24 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-8c05b177-b3a8-423d-b8f2-a0b341916714 tempest-ProjectMemberTests-1612262589 None] Created volume successfully. Sep 25 11:04:25 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Delete snapshot completed successfully. Sep 25 11:04:25 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-cfbd5635-da91-4d75-a62f-317dd004e88f tempest-ProjectReaderTests-330771959 None] Lock "cinder-e8fed66d-0084-4018-a57c-18f62cb70599-delete_snapshot" released by "delete_snapshot" :: held 2.578s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:04:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:26 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:26 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:26 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.253s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:04:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:04:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:04:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:26 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Lock "cinder-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:27 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f" acquired by "delete_volume" :: waited 0.015s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:27 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dc2405-7596-4d96-88a8-89fec33b23b3]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:27 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f Sep 25 11:04:27 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:28 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f" returned: 0 in 0.379s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:28 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f Sep 25 11:04:28 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:28 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f" returned: 0 in 0.247s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:28 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f" released by "delete_volume" :: held 0.692s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:28 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] Creating offline snapshot fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 of volume f5284aa4-8f19-42c9-83ed-d25e891114f7 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:04:28 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[738daf8f-70ba-4874-8ffb-4c3fd1b9606e]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:28 devstack sudo[109329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 Sep 25 11:04:28 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:28 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Created reservations ['e0e9243b-fdce-4184-864f-3c10e7a22c0a', 'b824c538-a284-426d-8952-db70b442975a', '75017c9b-0796-42ed-9ae1-156500ec031f', 'f986f2ed-0439-41fb-8063-7ecf34c3c4ff'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:28 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7" returned: 0 in 0.387s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:28 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 1G Sep 25 11:04:28 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:29 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 1G" returned: 0 in 0.412s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:29 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 Sep 25 11:04:29 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:29 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2" returned: 0 in 0.277s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:29 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 is being set with open permissions: ugo+rw Sep 25 11:04:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:29 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 Sep 25 11:04:29 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:29 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2" returned: 0 in 0.242s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:30 devstack sudo[109347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:30 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:30 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.info Sep 25 11:04:30 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:30 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.249s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:30 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:30 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Deleted volume successfully. Sep 25 11:04:30 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.info" returned: 0 in 0.267s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:30 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.info is being set with open permissions: ugo+rw Sep 25 11:04:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:30 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.info Sep 25 11:04:30 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:30 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.info" returned: 0 in 0.243s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:31 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-02e187bc-0371-4969-b483-d7e92507cbe8 tempest-ProjectMemberTests-1612262589 None] Create snapshot completed successfully Sep 25 11:04:31 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-674fa8cc-0d4d-4881-b6e7-3796fdabd22d tempest-ProjectReaderTests-330771959 None] Lock "cinder-80fa1f29-064f-4f18-82fe-5a37ee2fdf5f-delete_volume" released by "delete_volume" :: held 4.730s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Lock "cinder-fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-f5284aa4-8f19-42c9-83ed-d25e891114f7" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-f5284aa4-8f19-42c9-83ed-d25e891114f7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Deleting offline snapshot fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 of volume f5284aa4-8f19-42c9-83ed-d25e891114f7 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] snapshot_file for this snap is: volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a33b67-b962-4728-bf0d-3e0790f86276]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:35 devstack sudo[109356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 Sep 25 11:04:35 devstack sudo[109356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:35 devstack sudo[109356]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2" returned: 0 in 0.392s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5284aa4-8f19-42c9-83ed-d25e891114f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f81f434-7bd9-40bb-871d-59ae5ee2a1d7]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:35 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:04:35 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Flow 'volume_create_manager' (5171f2de-a81a-4980-9386-7b0d692ba987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2be2a6-1620-426e-89d7-d25a608f8342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2be2a6-1620-426e-89d7-d25a608f8342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144792529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a18f1c5a-24a7-40b3-942c-4e021208cdc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc760b9e55140aca9ee821d0a06d9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:36Z,use_quota=True,user_id='b1e4775c380f4be59076858366e912bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c796b57e-9630-4ffb-b0a6-5ead63a8f845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c796b57e-9630-4ffb-b0a6-5ead63a8f845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7060c71c-2faa-4efd-91da-5af57b6a157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7060c71c-2faa-4efd-91da-5af57b6a157b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a18f1c5a-24a7-40b3-942c-4e021208cdc0', 'volume_name': 'volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d5f1af-8959-438b-b696-e9955c1d301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d5f1af-8959-438b-b696-e9955c1d301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5f9bbc-128d-49d9-857b-91e76cc5c420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:35 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Volume a18f1c5a-24a7-40b3-942c-4e021208cdc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0', 'volume_size': 1} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144792529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a18f1c5a-24a7-40b3-942c-4e021208cdc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc760b9e55140aca9ee821d0a06d9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:36Z,use_quota=True,user_id='b1e4775c380f4be59076858366e912bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Creating volume a18f1c5a-24a7-40b3-942c-4e021208cdc0 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:04:35 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:04:35 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:35 devstack sudo[109363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 1073741824 Sep 25 11:04:35 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:36 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7" returned: 0 in 0.423s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:36 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 Sep 25 11:04:36 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:36 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 1073741824" returned: 0 in 0.432s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=247,cinder:SELECT=183,cinder:INSERT=68,cinder:DELETE=25 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:36 devstack sudo[109377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 Sep 25 11:04:36 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:36 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2" returned: 0 in 0.387s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:36 devstack sudo[109379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2 Sep 25 11:04:36 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:36 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0" returned: 0 in 0.251s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5f9bbc-128d-49d9-857b-91e76cc5c420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585a2684-8d72-458d-9ad3-99dc933b7649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:36 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Volume volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 (a18f1c5a-24a7-40b3-942c-4e021208cdc0): created successfully Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585a2684-8d72-458d-9ad3-99dc933b7649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Flow 'volume_create_manager' (5171f2de-a81a-4980-9386-7b0d692ba987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:36 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-d9fb09b2-53ca-40c5-acc9-fc04c08379a5 tempest-ProjectReaderTests-330771959 None] Created volume successfully. Sep 25 11:04:36 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7.fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2" returned: 0 in 0.276s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2" released by "_delete_snapshot" :: held 1.612s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-f5284aa4-8f19-42c9-83ed-d25e891114f7" released by "delete_snapshot" :: held 1.641s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Created reservations ['705370e2-18d4-4659-9fcb-a59a767fd10e', 'df0a3768-6336-4d12-a6c0-94ba6b5f3f72', '5cd53d21-cfef-470a-b96b-af3214f11a60', 'd1edc537-12b6-4a1b-81ba-edeb410e5058'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=189,cinder:INSERT=72,cinder:UPDATE=264,cinder:DELETE=17 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:04:36 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Delete snapshot completed successfully. Sep 25 11:04:36 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b6b5deab-354a-4a34-b345-2ab1c46861ac tempest-ProjectMemberTests-1612262589 None] Lock "cinder-fd5b53a8-3d9a-4e56-9fbd-f20408c48ce2-delete_snapshot" released by "delete_snapshot" :: held 1.784s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-f5284aa4-8f19-42c9-83ed-d25e891114f7-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-f5284aa4-8f19-42c9-83ed-d25e891114f7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-f5284aa4-8f19-42c9-83ed-d25e891114f7" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-f5284aa4-8f19-42c9-83ed-d25e891114f7" acquired by "delete_volume" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:37 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec21e248-58e8-4f43-b5ae-cb49b33209d9]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:37 devstack sudo[109383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 Sep 25 11:04:37 devstack sudo[109383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:37 devstack sudo[109383]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7" returned: 0 in 0.384s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:37 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7 Sep 25 11:04:37 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] Creating offline snapshot 77d79e9c-166c-4d90-8a78-49285c4e6efe of volume a18f1c5a-24a7-40b3-942c-4e021208cdc0 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:04:38 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-f5284aa4-8f19-42c9-83ed-d25e891114f7" returned: 0 in 0.284s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce580447-55c8-4a84-9012-339d1c2b07e2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-f5284aa4-8f19-42c9-83ed-d25e891114f7" released by "delete_volume" :: held 0.744s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Created reservations ['40d8d743-b976-4086-bbcc-07d993c8f258', '7936530d-1650-4668-81f4-ce2856cb835e', '4ecc1f5c-bdc7-4616-b39d-02f286d95ef9', '51dc614c-44f6-4317-bff2-59fb7447fac7'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:38 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 Sep 25 11:04:38 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:38 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:38 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:38 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.286s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:38 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0" returned: 0 in 0.447s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:38 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Deleted volume successfully. Sep 25 11:04:38 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe 1G Sep 25 11:04:38 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-7554e6ac-9f0e-4955-9d4c-2225176ffe26 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-f5284aa4-8f19-42c9-83ed-d25e891114f7-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:38 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:04:39 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (dd39f110-69fe-47fb-8f7a-c875b8e67743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb4d1bf-f21c-439c-8db2-3fd7caa94b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe 1G" returned: 0 in 0.498s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb4d1bf-f21c-439c-8db2-3fd7caa94b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437637350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320e5007-4097-48a2-935f-7c8110886eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:39Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:39 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe Sep 25 11:04:39 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f88ef4b-d3be-40f2-82ba-6bebcab593d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f88ef4b-d3be-40f2-82ba-6bebcab593d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63048aa4-fd0b-495b-8d9f-dd110f94d01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63048aa4-fd0b-495b-8d9f-dd110f94d01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '320e5007-4097-48a2-935f-7c8110886eb5', 'volume_name': 'volume-320e5007-4097-48a2-935f-7c8110886eb5', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb5c902-0301-4706-b0ec-64c7bdb2032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb5c902-0301-4706-b0ec-64c7bdb2032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b337a14-16a5-4e34-a59f-13440e2ab581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:39 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Volume 320e5007-4097-48a2-935f-7c8110886eb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-320e5007-4097-48a2-935f-7c8110886eb5', 'volume_size': 1} Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:39 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe" returned: 0 in 0.298s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:39 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe is being set with open permissions: ugo+rw Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:39 devstack sudo[109411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe Sep 25 11:04:39 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:39 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe" returned: 0 in 0.270s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:39 devstack sudo[109414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.info Sep 25 11:04:39 devstack sudo[109414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:39 devstack sudo[109414]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.info" returned: 0 in 0.271s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:39 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.info is being set with open permissions: ugo+rw Sep 25 11:04:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:39 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.info Sep 25 11:04:39 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:40 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.info" returned: 0 in 0.239s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.067s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437637350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320e5007-4097-48a2-935f-7c8110886eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1a6650bcf24d51bcf38eb19e0b3f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:39Z,use_quota=True,user_id='9e41a426acc04675acced63a72b1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Creating volume 320e5007-4097-48a2-935f-7c8110886eb5 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:04:40 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:40 devstack sudo[109420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5 1073741824 Sep 25 11:04:40 devstack sudo[109420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:40 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-7578e5d8-ab8f-4e99-b755-1a47252a42f4 tempest-ProjectReaderTests-330771959 None] Create snapshot completed successfully Sep 25 11:04:40 devstack sudo[109420]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5 1073741824" returned: 0 in 0.395s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:40 devstack sudo[109425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5 Sep 25 11:04:40 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:40 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5" returned: 0 in 0.248s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b337a14-16a5-4e34-a59f-13440e2ab581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320e5007-4097-48a2-935f-7c8110886eb5', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cebe14a-d424-4315-a1b8-0b8fdc46d932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:40 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Volume volume-320e5007-4097-48a2-935f-7c8110886eb5 (320e5007-4097-48a2-935f-7c8110886eb5): created successfully Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cebe14a-d424-4315-a1b8-0b8fdc46d932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:40 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Flow 'volume_create_manager' (dd39f110-69fe-47fb-8f7a-c875b8e67743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:40 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-4db35eae-137d-4116-85df-8b1c59be948f tempest-ProjectMemberTests-1612262589 None] Created volume successfully. Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] Creating offline snapshot 20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 of volume 320e5007-4097-48a2-935f-7c8110886eb5 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-77d79e9c-166c-4d90-8a78-49285c4e6efe-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f822df-afda-4c62-8cd9-0dc8411bb620]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Lock "cinder-77d79e9c-166c-4d90-8a78-49285c4e6efe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-a18f1c5a-24a7-40b3-942c-4e021208cdc0" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-a18f1c5a-24a7-40b3-942c-4e021208cdc0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-77d79e9c-166c-4d90-8a78-49285c4e6efe" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-77d79e9c-166c-4d90-8a78-49285c4e6efe" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Deleting offline snapshot 77d79e9c-166c-4d90-8a78-49285c4e6efe of volume a18f1c5a-24a7-40b3-942c-4e021208cdc0 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] snapshot_file for this snap is: volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed4b971-1bf1-4fce-b9b0-e7ad1467fa5c]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:41 devstack sudo[109428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5 Sep 25 11:04:41 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:41 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe Sep 25 11:04:41 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:41 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5" returned: 0 in 0.361s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:41 devstack sudo[109435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 1G Sep 25 11:04:41 devstack sudo[109435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:41 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe" returned: 0 in 0.372s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d64dd40-50e0-4d82-9a44-b7d61db3f9a3]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:41 devstack sudo[109440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 Sep 25 11:04:41 devstack sudo[109440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:42 devstack sudo[109435]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 1G" returned: 0 in 0.456s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320e5007-4097-48a2-935f-7c8110886eb5 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:42 devstack sudo[109448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320e5007-4097-48a2-935f-7c8110886eb5 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 Sep 25 11:04:42 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:42 devstack sudo[109440]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0" returned: 0 in 0.371s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:42 devstack sudo[109450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe Sep 25 11:04:42 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:42 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320e5007-4097-48a2-935f-7c8110886eb5 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03" returned: 0 in 0.318s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:42 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 is being set with open permissions: ugo+rw Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:42 devstack sudo[109458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 Sep 25 11:04:42 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:42 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe" returned: 0 in 0.342s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:42 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe Sep 25 11:04:42 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:42 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03" returned: 0 in 0.256s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:42 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0.77d79e9c-166c-4d90-8a78-49285c4e6efe" returned: 0 in 0.238s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:42 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.info Sep 25 11:04:42 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-77d79e9c-166c-4d90-8a78-49285c4e6efe" released by "_delete_snapshot" :: held 1.426s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-a18f1c5a-24a7-40b3-942c-4e021208cdc0" released by "delete_snapshot" :: held 1.447s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Created reservations ['641565f2-6bd2-4aa6-8b85-59a441ff5802', 'b8884c4a-9051-4135-a703-b0cfbad4016f', '8ba90420-fcbf-4b34-94fc-f0074c2dcbb4', 'b148d43c-b30f-499e-94b5-4e544b66626f'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:42 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Delete snapshot completed successfully. Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-f8068827-a331-4e15-877f-1807985ed96b tempest-ProjectReaderTests-330771959 None] Lock "cinder-77d79e9c-166c-4d90-8a78-49285c4e6efe-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:42 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.info" returned: 0 in 0.264s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:42 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.info is being set with open permissions: ugo+rw Sep 25 11:04:42 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:42 devstack sudo[109467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.info Sep 25 11:04:42 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:43 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.info" returned: 0 in 0.241s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.991s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:43 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-120a0abd-09ce-435f-a964-a981b2054d99 tempest-ProjectMemberTests-1612262589 None] Create snapshot completed successfully Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-a18f1c5a-24a7-40b3-942c-4e021208cdc0-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Lock "cinder-a18f1c5a-24a7-40b3-942c-4e021208cdc0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-a18f1c5a-24a7-40b3-942c-4e021208cdc0" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-a18f1c5a-24a7-40b3-942c-4e021208cdc0" acquired by "delete_volume" :: waited 0.020s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-20e3f309-a2f4-4fa3-b89f-b2c8cec75f03-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df3496a-e3c7-429d-bfa6-df67c2172b18]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-20e3f309-a2f4-4fa3-b89f-b2c8cec75f03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-320e5007-4097-48a2-935f-7c8110886eb5" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-320e5007-4097-48a2-935f-7c8110886eb5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-20e3f309-a2f4-4fa3-b89f-b2c8cec75f03" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-20e3f309-a2f4-4fa3-b89f-b2c8cec75f03" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Deleting offline snapshot 20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 of volume 320e5007-4097-48a2-935f-7c8110886eb5 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] snapshot_file for this snap is: volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d034b5-25c6-4510-986b-cd5e7636c765]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:43 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 Sep 25 11:04:43 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:43 devstack sudo[109471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 Sep 25 11:04:43 devstack sudo[109471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:43 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0" returned: 0 in 0.384s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:43 devstack sudo[109477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0 Sep 25 11:04:43 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:43 devstack sudo[109471]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03" returned: 0 in 0.407s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-320e5007-4097-48a2-935f-7c8110886eb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:04:43 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6482b37-8fe9-413d-9747-2c86200872b9]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:44 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5 Sep 25 11:04:44 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:44 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-a18f1c5a-24a7-40b3-942c-4e021208cdc0" returned: 0 in 0.257s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-a18f1c5a-24a7-40b3-942c-4e021208cdc0" released by "delete_volume" :: held 0.718s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Created reservations ['54a39b37-e24c-474d-b577-a16856f16417', '08febf37-713c-4234-9afc-2f823783c905', 'fc1269d5-2c38-47a1-ad98-d09cb79db616', '45879762-2950-4c24-bf64-6d1cef7aee69'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:44 devstack sudo[109485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:44 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:44 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5" returned: 0 in 0.386s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:44 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 Sep 25 11:04:44 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:44 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.261s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:44 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Deleted volume successfully. Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-bef9f5ad-8139-4d2d-89bb-1ccd535d3a72 tempest-ProjectReaderTests-330771959 None] Lock "cinder-a18f1c5a-24a7-40b3-942c-4e021208cdc0-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:44 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03" returned: 0 in 0.379s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:44 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:44 devstack sudo[109496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03 Sep 25 11:04:44 devstack sudo[109496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:45 devstack sudo[109496]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Flow 'volume_create_manager' (1f6421da-5d6e-489b-a884-ac455df18062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a444b8d-0a2d-4b5c-89d9-01928961c540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5.20e3f309-a2f4-4fa3-b89f-b2c8cec75f03" returned: 0 in 0.299s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a444b8d-0a2d-4b5c-89d9-01928961c540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-27915479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c07f4a-1303-4090-9e11-07cae735b967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc760b9e55140aca9ee821d0a06d9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:45Z,use_quota=True,user_id='b1e4775c380f4be59076858366e912bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd234bbf-25c6-4a41-a2c8-3f8189566a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd234bbf-25c6-4a41-a2c8-3f8189566a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab276649-4037-4d4b-9525-b924b26e1656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab276649-4037-4d4b-9525-b924b26e1656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c07f4a-1303-4090-9e11-07cae735b967', 'volume_name': 'volume-09c07f4a-1303-4090-9e11-07cae735b967', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48cdd1e5-4722-4d78-aaa6-3f69f275325c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48cdd1e5-4722-4d78-aaa6-3f69f275325c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a93557-99db-4a79-b0e0-9b84c3ae7057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:45 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Volume 09c07f4a-1303-4090-9e11-07cae735b967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c07f4a-1303-4090-9e11-07cae735b967', 'volume_size': 1} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-27915479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c07f4a-1303-4090-9e11-07cae735b967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc760b9e55140aca9ee821d0a06d9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:04:45Z,use_quota=True,user_id='b1e4775c380f4be59076858366e912bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Creating volume 09c07f4a-1303-4090-9e11-07cae735b967 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:04:45 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-20e3f309-a2f4-4fa3-b89f-b2c8cec75f03" released by "_delete_snapshot" :: held 1.628s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-320e5007-4097-48a2-935f-7c8110886eb5" released by "delete_snapshot" :: held 1.653s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:45 devstack sudo[109499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967 1073741824 Sep 25 11:04:45 devstack sudo[109499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Created reservations ['94c5df10-961d-4796-8524-8af6a61fbe0c', '91895b93-4fc0-4807-9c71-b89b79465f9e', '9fb2aed2-cd18-4e94-8f75-3968094bd0d4', 'e2ed8c4e-4fdb-402e-bbfd-996e1f0d424c'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:45 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Delete snapshot completed successfully. Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-701c26b6-9d80-4172-81ec-5248bb80df5b tempest-ProjectMemberTests-1612262589 None] Lock "cinder-20e3f309-a2f4-4fa3-b89f-b2c8cec75f03-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:45 devstack sudo[109499]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967 1073741824" returned: 0 in 0.451s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-320e5007-4097-48a2-935f-7c8110886eb5-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-320e5007-4097-48a2-935f-7c8110886eb5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "cinder-quobyte-320e5007-4097-48a2-935f-7c8110886eb5" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:45 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967 Sep 25 11:04:45 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-320e5007-4097-48a2-935f-7c8110886eb5" acquired by "delete_volume" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c7c0fd-0be5-4a3e-a23f-853be9edc1d5]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:45 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5 Sep 25 11:04:45 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:45 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967" returned: 0 in 0.290s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a93557-99db-4a79-b0e0-9b84c3ae7057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c07f4a-1303-4090-9e11-07cae735b967', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b39142f-3e2c-48c1-9ec3-52131a1f29cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:04:45 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Volume volume-09c07f4a-1303-4090-9e11-07cae735b967 (09c07f4a-1303-4090-9e11-07cae735b967): created successfully Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b39142f-3e2c-48c1-9ec3-52131a1f29cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:04:45 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Flow 'volume_create_manager' (1f6421da-5d6e-489b-a884-ac455df18062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:04:46 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-26d45ad6-d019-4d0f-92b5-4e27a43e099a tempest-ProjectReaderTests-330771959 None] Created volume successfully. Sep 25 11:04:46 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5" returned: 0 in 0.391s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:46 devstack sudo[109513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5 Sep 25 11:04:46 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:46 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-320e5007-4097-48a2-935f-7c8110886eb5" returned: 0 in 0.250s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-quobyte-320e5007-4097-48a2-935f-7c8110886eb5" released by "delete_volume" :: held 0.709s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:46 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Created reservations ['d99859a0-3ea3-46b7-9e83-bf9bd58a43d2', 'aba02067-d02f-4a3d-81f3-0b401abf183d', '95913790-5ef5-4f4b-b4b1-8c4cf432a6ce', '6ed2ab91-c6a3-427b-a901-6d18c03a65fd'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:46 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:46 devstack sudo[109516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:46 devstack sudo[109516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:46 devstack sudo[109516]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:46 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.267s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:46 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:46 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Deleted volume successfully. Sep 25 11:04:46 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-02156511-5f80-42f2-835f-acacbad37c00 tempest-ProjectMemberTests-1612262589 None] Lock "cinder-320e5007-4097-48a2-935f-7c8110886eb5-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:47 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] Creating offline snapshot 4c723ae6-acbb-41b3-b994-029994af18de of volume 09c07f4a-1303-4090-9e11-07cae735b967 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:04:47 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c089af-7cdd-4408-8016-86e56f923827]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:47 devstack sudo[109519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967 Sep 25 11:04:47 devstack sudo[109519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:47 devstack sudo[109519]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967" returned: 0 in 0.380s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:47 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:47 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de 1G Sep 25 11:04:47 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:48 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de 1G" returned: 0 in 0.464s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c07f4a-1303-4090-9e11-07cae735b967 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:48 devstack sudo[109530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c07f4a-1303-4090-9e11-07cae735b967 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de Sep 25 11:04:48 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:48 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c07f4a-1303-4090-9e11-07cae735b967 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de" returned: 0 in 0.340s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:48 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de is being set with open permissions: ugo+rw Sep 25 11:04:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:48 devstack sudo[109536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de Sep 25 11:04:48 devstack sudo[109536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:48 devstack sudo[109536]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de" returned: 0 in 0.261s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:48 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:48 devstack sudo[109539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.info Sep 25 11:04:48 devstack sudo[109539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:49 devstack sudo[109539]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.info" returned: 0 in 0.284s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:49 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.info is being set with open permissions: ugo+rw Sep 25 11:04:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:49 devstack sudo[109542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.info Sep 25 11:04:49 devstack sudo[109542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:49 devstack sudo[109542]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.info" returned: 0 in 0.291s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:49 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:49 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-87529b7d-750d-46a9-931b-a094ea3b3e55 tempest-ProjectReaderTests-330771959 None] Create snapshot completed successfully Sep 25 11:04:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-4c723ae6-acbb-41b3-b994-029994af18de-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Lock "cinder-4c723ae6-acbb-41b3-b994-029994af18de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-09c07f4a-1303-4090-9e11-07cae735b967" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-09c07f4a-1303-4090-9e11-07cae735b967" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-4c723ae6-acbb-41b3-b994-029994af18de" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:50 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-4c723ae6-acbb-41b3-b994-029994af18de" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Deleting offline snapshot 4c723ae6-acbb-41b3-b994-029994af18de of volume 09c07f4a-1303-4090-9e11-07cae735b967 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:04:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] snapshot_file for this snap is: volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:04:50 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdce1d50-bf47-4401-b320-62d34fdeb3d0]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:50 devstack sudo[109546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de Sep 25 11:04:50 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:50 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:50 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de" returned: 0 in 0.439s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:50 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09c07f4a-1303-4090-9e11-07cae735b967(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:04:51 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fc5a9b-20f5-4e13-8c7f-71976eba1891]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:51 devstack sudo[109551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967 Sep 25 11:04:51 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:51 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967" returned: 0 in 0.389s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:51 devstack sudo[109556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de Sep 25 11:04:51 devstack sudo[109556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:51 devstack sudo[109556]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de" returned: 0 in 0.428s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:51 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:51 devstack sudo[109562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de Sep 25 11:04:51 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:52 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967.4c723ae6-acbb-41b3-b994-029994af18de" returned: 0 in 0.278s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-4c723ae6-acbb-41b3-b994-029994af18de" released by "_delete_snapshot" :: held 1.658s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-09c07f4a-1303-4090-9e11-07cae735b967" released by "delete_snapshot" :: held 1.695s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:52 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Created reservations ['d01e67de-cfbe-4671-b09c-794b50866caf', 'f984e321-cc59-4c60-a225-0aa095c3c73c', '30e9d9c5-b081-4d71-9467-306925cceae7', '8e4e98a1-3d8b-47b9-b2d0-79e8cf590244'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:52 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Delete snapshot completed successfully. Sep 25 11:04:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-be5b73d1-d353-400a-8dfe-5b9a29e0e8a6 tempest-ProjectReaderTests-330771959 None] Lock "cinder-4c723ae6-acbb-41b3-b994-029994af18de-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-09c07f4a-1303-4090-9e11-07cae735b967-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Lock "cinder-09c07f4a-1303-4090-9e11-07cae735b967-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Acquiring lock "cinder-quobyte-09c07f4a-1303-4090-9e11-07cae735b967" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:04:52 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-09c07f4a-1303-4090-9e11-07cae735b967" acquired by "delete_volume" :: waited 0.017s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:04:52 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f904a0-6b07-4c86-8b1e-91af71b447ed]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:04:52 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:52 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967 Sep 25 11:04:52 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:53 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967" returned: 0 in 0.430s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:53 devstack sudo[109572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967 Sep 25 11:04:53 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:53 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:53 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-09c07f4a-1303-4090-9e11-07cae735b967" returned: 0 in 0.284s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:53 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Lock "cinder-quobyte-09c07f4a-1303-4090-9e11-07cae735b967" released by "delete_volume" :: held 0.796s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:04:53 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Created reservations ['413ab89b-f51a-4428-9514-0d024266d874', '86ed0944-847e-4171-89a8-e5a94198387d', 'a3da1b99-e08c-4df2-a0d8-382850afbfdd', '9b6a9c4f-dbde-4e25-9c36-55feca1e256b'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:04:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:04:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:04:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:04:54 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:04:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:04:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:04:54 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:04:54 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:04:54 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Sep 25 11:04:54 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.250s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:04:54 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:04:54 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Deleted volume successfully. Sep 25 11:04:55 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-52d89436-eb8f-4150-a2c6-3cdd6f88d126 tempest-ProjectReaderTests-330771959 None] Lock "cinder-09c07f4a-1303-4090-9e11-07cae735b967-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:05:03 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=47,cinder:UPDATE=59,cinder:INSERT=18,cinder:DELETE=3 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:05:04 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:UPDATE=65,cinder:SELECT=48,cinder:INSERT=16,cinder:DELETE=6 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Flow 'volume_create_manager' (77cab768-99d2-4977-a493-35a3dd59d3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319a487e-8575-4929-b674-19f0a3eda180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319a487e-8575-4929-b674-19f0a3eda180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1800186371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798f7581-da47-49cd-980b-20ea1002a1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fe2e142a6a4febb1215fcabcf71d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:05:25Z,use_quota=True,user_id='a513a92920dd49ba9a3c13b779bbaaaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94a5522-954b-4ab3-8391-0243e7c22c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94a5522-954b-4ab3-8391-0243e7c22c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb78679-dead-4a5d-9d9d-903abfa32d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb78679-dead-4a5d-9d9d-903abfa32d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '798f7581-da47-49cd-980b-20ea1002a1c0', 'volume_name': 'volume-798f7581-da47-49cd-980b-20ea1002a1c0', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c7780b-c1ed-40a3-ad45-537abbd2d8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c7780b-c1ed-40a3-ad45-537abbd2d8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527eb29d-4534-4272-979a-fbb40f5b1639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:05:24 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Volume 798f7581-da47-49cd-980b-20ea1002a1c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-798f7581-da47-49cd-980b-20ea1002a1c0', 'volume_size': 1} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1800186371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798f7581-da47-49cd-980b-20ea1002a1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fe2e142a6a4febb1215fcabcf71d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:05:25Z,use_quota=True,user_id='a513a92920dd49ba9a3c13b779bbaaaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)}" {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Creating volume 798f7581-da47-49cd-980b-20ea1002a1c0 {{(pid=86874) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:05:24 devstack cinder-volume[86874]: INFO cinder.volume.drivers.remotefs [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 Sep 25 11:05:24 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 1073741824 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:24 devstack sudo[109628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 1073741824 Sep 25 11:05:24 devstack sudo[109628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:25 devstack sudo[109628]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 1073741824" returned: 0 in 0.476s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:25 devstack sudo[109634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 Sep 25 11:05:25 devstack sudo[109634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:25 devstack sudo[109634]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0" returned: 0 in 0.272s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:25 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'} {{(pid=86874) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 11:05:25 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:05:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527eb29d-4534-4272-979a-fbb40f5b1639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798f7581-da47-49cd-980b-20ea1002a1c0', 'volume_size': 1}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:05:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b51ade-dd30-4e0f-a5e8-ea78a2f25298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:05:25 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Volume volume-798f7581-da47-49cd-980b-20ea1002a1c0 (798f7581-da47-49cd-980b-20ea1002a1c0): created successfully Sep 25 11:05:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b51ade-dd30-4e0f-a5e8-ea78a2f25298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:05:25 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Flow 'volume_create_manager' (77cab768-99d2-4977-a493-35a3dd59d3ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:05:25 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-534e1c9d-1ca2-4313-9a25-9e03b2182586 tempest-SnapshotDependencyTests-840904051 None] Created volume successfully. Sep 25 11:05:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:05:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:05:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:05:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:05:26 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:05:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:05:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:26 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:05:26 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:26 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:26 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.279s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:26 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:05:26 devstack cinder-volume[86874]: DEBUG oslo_service.periodic_task [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] Running periodic task VolumeManager._thread_info {{(pid=86874) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:05:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread count: 28 {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:05:26 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-ec6fdb07-5304-427e-871c-9ff507956013 None None] thread info: [<_MainThread(MainThread, started 130103815196800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86874) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:05:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:05:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:05:27 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] Creating offline snapshot 634586b5-892d-47e8-a6bb-4de37f597f87 of volume 798f7581-da47-49cd-980b-20ea1002a1c0 {{(pid=86874) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:05:27 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d054bb01-05c6-4c80-b687-ba0431f80283]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:05:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:27 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 Sep 25 11:05:27 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:27 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0" returned: 0 in 0.405s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 1G {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:27 devstack sudo[109645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 1G Sep 25 11:05:27 devstack sudo[109645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:27 devstack sudo[109645]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 1G" returned: 0 in 0.394s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:27 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798f7581-da47-49cd-980b-20ea1002a1c0 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:27 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798f7581-da47-49cd-980b-20ea1002a1c0 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 Sep 25 11:05:27 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:28 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798f7581-da47-49cd-980b-20ea1002a1c0 -F qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87" returned: 0 in 0.277s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:28 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 is being set with open permissions: ugo+rw Sep 25 11:05:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:28 devstack sudo[109656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 Sep 25 11:05:28 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:28 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87" returned: 0 in 0.250s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:28 devstack sudo[109659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.info Sep 25 11:05:28 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:28 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.info" returned: 0 in 0.266s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:28 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.info is being set with open permissions: ugo+rw Sep 25 11:05:28 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.info {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:28 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.info Sep 25 11:05:28 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:29 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.info" returned: 0 in 0.245s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:05:29 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-acfc011e-7369-4d92-959a-6595db86fa45 tempest-SnapshotDependencyTests-840904051 None] Create snapshot completed successfully Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.flows.manager.create_volume [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86874) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Flow 'volume_create_manager' (ad6f669a-4cd0-4ad7-b186-8f493a57c879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93d027b-c3a0-443a-9f31-01de3f8c2b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93d027b-c3a0-443a-9f31-01de3f8c2b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c244ad4-17f4-489b-b4af-479b7bcfb41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fe2e142a6a4febb1215fcabcf71d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=634586b5-892d-47e8-a6bb-4de37f597f87,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:05:30Z,use_quota=True,user_id='a513a92920dd49ba9a3c13b779bbaaaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f0820d-801e-439a-b8a6-85fce53065a3),volume_type_id=00f0820d-801e-439a-b8a6-85fce53065a3)' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e852b4c3-626a-4db2-a0fb-360a321dd6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e852b4c3-626a-4db2-a0fb-360a321dd6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1011027-e4b1-439b-b4d0-76ea93f104ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1011027-e4b1-439b-b4d0-76ea93f104ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c244ad4-17f4-489b-b4af-479b7bcfb41f', 'volume_name': 'volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f', 'volume_size': 1, 'snapshot_id': '634586b5-892d-47e8-a6bb-4de37f597f87'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2e64fa-a05d-4fc4-93d1-2e89c62d0d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2e64fa-a05d-4fc4-93d1-2e89c62d0d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fbc020-10e1-4040-8b21-49e0ebd8dbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:05:29 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Volume 8c244ad4-17f4-489b-b4af-479b7bcfb41f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f', 'volume_size': 1, 'snapshot_id': '634586b5-892d-47e8-a6bb-4de37f597f87'} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "cinder-quobyte-634586b5-892d-47e8-a6bb-4de37f597f87-8c244ad4-17f4-489b-b4af-479b7bcfb41f" by "_create_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-quobyte-634586b5-892d-47e8-a6bb-4de37f597f87-8c244ad4-17f4-489b-b4af-479b7bcfb41f" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Creating volume 8c244ad4-17f4-489b-b4af-479b7bcfb41f from snapshot 634586b5-892d-47e8-a6bb-4de37f597f87 {{(pid=86874) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66 as target Quobyte volume. {{(pid=86874) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "cinder-quobyte-8c244ad4-17f4-489b-b4af-479b7bcfb41f" by "_copy_volume_from_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-quobyte-8c244ad4-17f4-489b-b4af-479b7bcfb41f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] snapshot: 634586b5-892d-47e8-a6bb-4de37f597f87, volume: 8c244ad4-17f4-489b-b4af-479b7bcfb41f, {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e737dc-88c8-4a57-86e0-de9e673baa20]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:05:29 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:30 devstack sudo[109665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 Sep 25 11:05:30 devstack sudo[109665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:30 devstack sudo[109665]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87" returned: 0 in 0.363s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-798f7581-da47-49cd-980b-20ea1002a1c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:05:30 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ee4bcc-839f-491d-95da-931197f4d5ab]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:05:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:30 devstack sudo[109670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 Sep 25 11:05:30 devstack sudo[109670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:30 devstack sudo[109670]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0" returned: 0 in 0.380s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] will copy from snapshot at /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:05:30 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Creating direct copy from snapshot {{(pid=86874) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:05:30 devstack cinder-volume[86874]: DEBUG cinder.utils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Path /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f not found in is_blk_device check {{(pid=86874) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 11:05:30 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:30 devstack sudo[109676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f Sep 25 11:05:30 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:36 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f" returned: 0 in 6.125s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:36 devstack cinder-volume[86874]: DEBUG cinder.image.image_utils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Image conversion details: src /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f {{(pid=86874) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:05:36 devstack cinder-volume[86874]: INFO cinder.image.image_utils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Converted 1024.00 MB image at 167.15 MB/s Sep 25 11:05:36 devstack cinder-volume[86874]: WARNING cinder.volume.drivers.remotefs [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f is being set with open permissions: ugo+rw Sep 25 11:05:36 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:36 devstack sudo[109689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f Sep 25 11:05:36 devstack sudo[109689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:37 devstack sudo[109689]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f" returned: 0 in 0.249s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-quobyte-8c244ad4-17f4-489b-b4af-479b7bcfb41f" released by "_copy_volume_from_snapshot" :: held 7.199s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-quobyte-634586b5-892d-47e8-a6bb-4de37f597f87-8c244ad4-17f4-489b-b4af-479b7bcfb41f" released by "_create_volume_from_snapshot" :: held 7.262s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.278s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fbc020-10e1-4040-8b21-49e0ebd8dbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f', 'volume_size': 1, 'snapshot_id': '634586b5-892d-47e8-a6bb-4de37f597f87'}' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e317af6-c56b-4a9f-b517-69d60cacdb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:05:37 devstack cinder-volume[86874]: INFO cinder.volume.flows.manager.create_volume [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Volume volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f (8c244ad4-17f4-489b-b4af-479b7bcfb41f): created successfully Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e317af6-c56b-4a9f-b517-69d60cacdb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86874) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Flow 'volume_create_manager' (ad6f669a-4cd0-4ad7-b186-8f493a57c879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86874) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:05:37 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-b210cfbc-2691-443b-8879-6b1fa34599f4 tempest-SnapshotDependencyTests-840904051 None] Created volume successfully. Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "cinder-634586b5-892d-47e8-a6bb-4de37f597f87-delete_snapshot" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-634586b5-892d-47e8-a6bb-4de37f597f87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "cinder-quobyte-798f7581-da47-49cd-980b-20ea1002a1c0" by "delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-quobyte-798f7581-da47-49cd-980b-20ea1002a1c0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "cinder-quobyte-634586b5-892d-47e8-a6bb-4de37f597f87" by "_delete_snapshot" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-quobyte-634586b5-892d-47e8-a6bb-4de37f597f87" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Deleting offline snapshot 634586b5-892d-47e8-a6bb-4de37f597f87 of volume 798f7581-da47-49cd-980b-20ea1002a1c0 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] snapshot_file for this snap is: volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 {{(pid=86874) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ad5c52-39c1-433e-9744-78c3b1249fc2]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:37 devstack sudo[109692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 Sep 25 11:05:37 devstack sudo[109692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:37 devstack sudo[109692]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87" returned: 0 in 0.370s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.remotefs [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-798f7581-da47-49cd-980b-20ea1002a1c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86874) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9981f2-3598-404a-bbf6-e98a96a38487]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:05:37 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:38 devstack sudo[109697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 Sep 25 11:05:38 devstack sudo[109697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:38 devstack sudo[109697]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0" returned: 0 in 0.518s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:38 devstack sudo[109703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 Sep 25 11:05:38 devstack sudo[109703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:38 devstack sudo[109703]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87" returned: 0 in 0.333s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:38 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:38 devstack sudo[109708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87 Sep 25 11:05:38 devstack sudo[109708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:39 devstack sudo[109708]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0.634586b5-892d-47e8-a6bb-4de37f597f87" returned: 0 in 0.257s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-quobyte-634586b5-892d-47e8-a6bb-4de37f597f87" released by "_delete_snapshot" :: held 1.582s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:05:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-quobyte-798f7581-da47-49cd-980b-20ea1002a1c0" released by "delete_snapshot" :: held 1.603s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:05:39 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Created reservations ['6ae30889-6df6-4f6f-9043-76cbf7cfa842', '4eeae3f4-e576-455e-ba38-7ad5fec24771', 'a5e2a900-93b3-4b6a-9622-d52fe43b9c09', '12cf4d38-048a-42ad-889a-5b449c49b56a'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:05:39 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Delete snapshot completed successfully. Sep 25 11:05:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a5314360-5c5c-43e0-a979-c51c86c6346e tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-634586b5-892d-47e8-a6bb-4de37f597f87-delete_snapshot" released by "delete_snapshot" :: held 1.741s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:05:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "cinder-798f7581-da47-49cd-980b-20ea1002a1c0-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:05:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-798f7581-da47-49cd-980b-20ea1002a1c0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:05:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "cinder-quobyte-798f7581-da47-49cd-980b-20ea1002a1c0" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:05:39 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-quobyte-798f7581-da47-49cd-980b-20ea1002a1c0" acquired by "delete_volume" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:05:39 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19c3636-f8ae-4a04-8995-8a2e247e2c1a]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:05:39 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:39 devstack sudo[109711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 Sep 25 11:05:39 devstack sudo[109711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:40 devstack sudo[109711]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0" returned: 0 in 0.365s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:40 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0 Sep 25 11:05:40 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:40 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-798f7581-da47-49cd-980b-20ea1002a1c0" returned: 0 in 0.258s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-quobyte-798f7581-da47-49cd-980b-20ea1002a1c0" released by "delete_volume" :: held 0.686s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Created reservations ['7f108f9e-9672-431a-b564-0bd8cb7a141c', '2cbff8e1-f065-41de-9410-c648906eb942', 'a43a1129-25c9-44cb-8651-f3742cf6f5e6', '969384d6-8bf8-4156-ba47-c722e70e4905'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:40 devstack sudo[109719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:05:40 devstack sudo[109719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:40 devstack sudo[109719]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.249s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:05:40 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Deleted volume successfully. Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "cinder-8c244ad4-17f4-489b-b4af-479b7bcfb41f-delete_volume" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a7d965b0-b0b2-4a4a-be92-2a985cb826db tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-798f7581-da47-49cd-980b-20ea1002a1c0-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-8c244ad4-17f4-489b-b4af-479b7bcfb41f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "cinder-quobyte-8c244ad4-17f4-489b-b4af-479b7bcfb41f" by "delete_volume" {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-quobyte-8c244ad4-17f4-489b-b4af-479b7bcfb41f" acquired by "delete_volume" :: waited 0.016s {{(pid=86874) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG oslo.privsep.daemon [-] privsep: reply[92119c06-7a26-4113-a8b4-92a6ed0bcf2d]: (4, 'qcow2') {{(pid=88786) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:05:40 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:40 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f Sep 25 11:05:40 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:41 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f" returned: 0 in 0.376s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:41 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f Sep 25 11:05:41 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:41 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc/volume-8c244ad4-17f4-489b-b4af-479b7bcfb41f" returned: 0 in 0.253s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-quobyte-8c244ad4-17f4-489b-b4af-479b7bcfb41f" released by "delete_volume" :: held 0.674s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:05:41 devstack cinder-volume[86874]: DEBUG cinder.quota [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Created reservations ['cae1498e-442a-4deb-bd0a-aa3f1deab4c1', 'fd178b1d-6c20-492d-b3ed-5b06c2a607ad', '85a3f584-2d80-4cba-af26-7cfd43e72e1e', '66300508-65fa-4516-a2bb-d2e78007c020'] {{(pid=86874) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:05:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:05:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:05:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66': None} {{(pid=86874) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:05:41 devstack cinder-volume[86874]: DEBUG cinder.volume.drivers.quobyte [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc5b4ba-5c90-4c53-a00a-6d8805b96a66'] {{(pid=86874) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:05:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.lockutils [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86874) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:05:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:05:41 devstack sudo[109731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc Sep 25 11:05:41 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:05:41 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root Sep 25 11:05:41 devstack cinder-volume[86874]: DEBUG oslo_concurrency.processutils [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/971ff713016c1f9bf973c8a987cf92dc" returned: 0 in 0.239s {{(pid=86874) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:05:41 devstack cinder-volume[86874]: DEBUG cinder.manager [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Notifying Schedulers of capabilities ... {{(pid=86874) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:05:41 devstack cinder-volume[86874]: INFO cinder.volume.manager [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Deleted volume successfully. Sep 25 11:05:41 devstack cinder-volume[86874]: DEBUG cinder.coordination [None req-a3cb2afc-86f4-42d4-83af-edb9383f126f tempest-SnapshotDependencyTests-840904051 None] Lock "cinder-8c244ad4-17f4-489b-b4af-479b7bcfb41f-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86874) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:05:51 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=23,cinder:INSERT=7,cinder:UPDATE=32 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:05:51 devstack cinder-volume[86874]: DEBUG dbcounter [-] [86874] Writing DB stats cinder:SELECT=27,cinder:UPDATE=27,cinder:DELETE=5,cinder:INSERT=8 {{(pid=86874) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}